Big Data Engineer - Spark / Scala / Java

Description

Summary: This role involves developing new features, maintaining applications, improving data pipelines, and optimizing integrations within the software development lifecycle. Highlights: 1. Develop new features and perform testing of implemented solutions 2. Improve and industrialize the end-to-end data pipeline 3. Participate in all stages of the software development lifecycle We are looking for a Big Data Engineer \- Spark / Scala / Java to work in Lisbon who's eager to embark on an exciting new opportunity! Apply here \ About KWAN We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in\-house specialists \- our People Experience Partners \- to guide them through our journey with us. What you’ll be doing: * Develop new features and perform testing of implemented solutions; * Provide evolutionary maintenance for mature and existing applications; * Participate in all stages of the software development lifecycle; * Improve and industrialize the end\-to\-end data pipeline; * Optimize integrations with downstream applications to enhance production performance and reliability; * Integrate new sensitivities to support business expansion; * Develop additional sensitivity calculations directly within the Susanoo platform; * Continuously improve processes by leveraging new capabilities of the Hadoop cluster; * Provide support to end users; * Participate in L2/L3 support rotation (\~every 6 weeks); * Participate in on\-call support rotation (\~every 4 weeks).Big Data Engineer \- Spark / Scala / Java What we are looking for * Bachelor’s degree in Computer Science, Software Engineering, or a related field; * Strong experience with Spark and distributed systems, including: Hadoop, Spark, Hive, kKafka, Solid knowledge of SQL; * Experience with Scala or Java; * Experience with code versioning and CI/CD tools, such as: Git, Jira, Jenkins, BitBucket, XLDeploy; * Strong coding standards and a test\-driven mindset; * English proficiency at minimum B2 level. Nice to Have * Knowledge of Spring Boot; * Experience with orchestration tools such as Control\-M; * Experience with financial systems; * Strong communication skills, proactive mindset, and innovative thinking; * Strong analytical and problem\-solving abilities. Do you meet most of the position requirements? Then grab this opportunity and apply now! \ What we offer * A project that matches your skills and ambitions, as well as your preferences for working policies and culture; * A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income; * An empowering and respectful work culture enriched with social and learning events; * A People Experience Partner specially assigned to you \- your go\-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work\-life balance at KWAN. Some Words From Our Colleagues “At KWAN, they make sure that I feel comfortable with the client I’m working for and that what I’m doing aligns with my career aspirations.” \- Luis Caldeira, DevOps @ KWAN Does it sound exciting? Apply now! \ Poderá encontrar o anúncio original publicado em: https://www.itjobs.pt/oferta/513800/big\-data\-engineer\-spark\-scala\-java