Data Engineer- GCP

Description

Summary: We are seeking a Data Engineer to design, build, and maintain scalable data platforms, process large datasets, and collaborate with teams to ensure data integrity and security. Highlights: 1. Design, build, and maintain scalable data platforms 2. Collect, process, and analyze large and complex data sets 3. Collaborate with cross-functional teams We are looking for a Data Engineer with GCP to work in Porto or Lisbon who's eager to embark on an exciting new opportunity! Apply here \ **About KWAN** We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in\-house specialists \- our People Experience Partners \- to guide them through our journey with us. **What is this challenge about** * Design, build, and maintain scalable data platforms; * Collect, process, and analyze large and complex data sets from various sources; * Develop and implement data processing workflows using data processing framework technologies such as Spark, and Apache Beam; * Collaborate with cross\-functional teams to ensure data accuracy and integrity; * Ensure data security and privacy through proper implementation of access controls and data encryption; * Extraction of data from various sources, including databases, file systems, and APIs; * Monitor system performance and optimize for high availability and scalability. **Does it sound exciting? Apply now!** \ **What we are looking for** * At least 4 years of experience in similar roles; * Experience with cloud platforms and services for data engineering (GCP); * Proficiency in programming languages like Python, Java, or Scala; * Use of Big Data Tools as Spark, Flink, Kafka, Elastic Search, Hadoop, Hive, Sqoop, Flume, Impala, Kafka Streams and Connect, Druid, etc.; * Knowledge of data modeling and database design principles; * Familiarity with data integration and ETL tools (e.g., Apache Kafka, Talend); * Understanding of distributed systems and data processing architectures; * Strong SQL skills and experience with relational and NoSQL databases; * Familiarity with cloud platforms and services for data engineering (e.g., AWS S3, Azure Data Factory); * Experience with version control tools such as Git. * Proficiency in English – written. **Do you meet most of the position requirements? Then grab this opportunity and apply now!** \ **What we offer** * **A project that matches your skills and ambitions**, as well as your preferences for working policies and culture. * **A competitive salary with awesome benefits** and opportunities to leverage your knowledge and network to earn additional income. * **An empowering and respectful work culture** enriched with social and learning events. * **A People Experience Partner specially assigned to you** \- your go\-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work\-life balance at KWAN. * **A relocation package and visa sponsorship** for all our international hires. **Some Words From Our Colleagues** “At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.” * Luis Caldeira, DevOps @ KWAN **Grab this opportunity, apply now!** \ Poderá encontrar o anúncio original publicado em: https://www.itjobs.pt/oferta/507364/data\-engineer\-gcp