Senior Data Platform Engineer (Remote)

Description

Summary: Join our Data Engineering team as a Senior Data Platform Engineer to develop and maintain data pipelines for blockchain data processing, actively participating in backend services and integrating new technologies. Highlights: 1. Develop and maintain data pipelines for blockchain data processing 2. Integrate blockchains, AMM protocols, and bridges into the platform 3. End-to-end feature designing and implementation **Position Summary:** We are looking for a talented Senior Data Platform Engineer to join our Data Engineering team, to participate in the development and maintenance of data pipelines for blockchain data processing. This is a remote role, and we are flexible with considering applications from anywhere in Europe. More details: crystalblockchain.com **Duties and responsibilities:** * Active participation in development and maintenance of our data pipelines and backend services; * Integration of blockchains, Automated Market Maker (AMM) protocols, and bridges within Crystal's platform; * Integrate new technologies into our processes and tools; * End\-to\-end feature designing and implementation; * Code, debug, test and deliver features and improvements in a continuous manner; * Provide code review, assistance, and feedback for other team members. **Required:** * 8\+ years of experience in software engineering, developing backend services/APIs or data pipelines; * Strong knowledge and experience with Python; * Advanced knowledge of SQL \- ability to write, understand and debug complex queries; * Strong database architecture principles; * Strong experience with data lakes, data warehouses, relational and analytical databases; * POSIX/Unix/Linux ecosystem knowledge; * Blockchain tech knowledge or willingness to learn; * Experienced in Unit Testing principles; * Experience with Docker containers and proven ability to migrate existing services; * Independent and autonomous way of working; * Team\-oriented work and good communication skills are an asset. **Would be a plus:** * Practical experience in big data and frameworks – Kafka, Spark, Dask, Flink and Data Lakes; * Experience with Kubernetes and Infrastructure as Code – Terraform and Ansible; * Experience with API frameworks such as Flask or FastAPI; * Experience with distributed systems; * Experience with opensource solutions; * Experience with Java or willingness to learn.