Senior Data Engineer

Description

Summary: Seeking an experienced Senior Data Engineer to design, build, and maintain enterprise data pipelines and solutions, focusing on governance, quality, and collaboration. Highlights: 1. Design, develop, and maintain robust ETL/ELT pipelines and data solutions. 2. Lead data refactoring and integration projects across the platform. 3. Contribute to data governance initiatives and ensure data quality. **Job Type:** Permanent**Build a brilliant future with Hiscox** **Role Overview:** We are seeking an experienced Senior Data Engineer to design, build, and maintain **enterprise data pipelines** and **data solutions** across our Microsoft\-centric platform. This hybrid role combines hands\-on technical expertise with a strong focus on data **governance**, **quality**, and **collaboration**. **Key Responsibilities:** * **ETL/ELT Pipelines:** Design, develop, and **maintain robust ETL/ELT pipelines** ensuring data is efficiently extracted, transformed, and loaded across systems. * **Data Engineering Projects:** Lead **data refactoring and integration projects** across the platform, optimising data flows and performance. * **Documentation \& Governance:** Maintain **high\-quality documentation** for data pipelines and architecture. Contribute to data **governance** initiatives to ensure data quality, security, and compliance. * **Cross\-Team Collaboration:** Work closely with Dynamics 365, Power Platform, and other cross\-functional teams to deliver integrated data solutions. **Engage stakeholders** to understand requirements and provide technical guidance. **Essential Skills \& Experience:** * **Database Proficiency:** Deep expertise in **Microsoft SQL** (T\-SQL) – able to write, optimise, and troubleshoot complex queries and stored procedures. * **Azure Data Factory (ADF):** Hands\-on experience developing and orchestrating pipelines with **Azure Data Factory**. * **Dynamics 365 \& Power Platform:** Proven experience working with **Microsoft Dynamics 365** and the **Power Platform** ecosystem. * **Dataverse:** **Strong experience with Microsoft Dataverse** (Common Data Service) – including data modelling and integration. (This is essential or a very strong advantage.) * **Data Architecture:** Solid understanding of **data modeling**, **data warehousing** concepts, and **ETL best practices** in a cloud environment. * **Collaboration \& Communication:** Excellent communication skills with the ability to **translate complex data concepts** for technical and non\-technical stakeholders. **Team\-oriented**, proactive in knowledge sharing, and adept at documentation. * **Problem\-Solving:** Demonstrated ability to **troubleshoot** data issues, optimise performance, and ensure reliability and accuracy of data pipelines. **Desirable Skills:** * **Microsoft Fabric:** Experience with **Microsoft Fabric (Azure)** for advanced analytics and data integration. * **Cloud Analytics:** Familiarity with **Azure Synapse Analytics** or **Azure Data Lake** for big data processing and warehousing. * **Scripting \& Automation:** Proficiency in a programming/scripting language (e.g., **Python** or **C\#** PowerShell) for advanced data transformation and automation. * **CI/CD \& DevOps:** Experience implementing **CI/CD pipelines** and version control (e.g., Azure DevOps, Git) for data engineering projects. * **Data Quality \& Governance Tools:** Experience using **data quality frameworks** or data governance tools to enforce standards and compliance. **Nice\-to\-Have Skills:** * **Big Data Tools:** Exposure to **Azure Databricks** * **BI \& Reporting:** Knowledge of **Power BI** or similar data visualisation/BI tools for supporting analytics and reporting needs. * **ML Pipelines:** Basic understanding of **machine learning pipelines** or model deployment in a data engineering context. **Other Information:** * **Work Arrangement:** This position is **based in Lisbon** with a hybrid working model (*on\-site at our Lisbon office approximately two days per week*). * **Mindset:** The ideal candidate is **detail\-oriented**, **self\-driven**, and passionate about clean, well\-governed data. They thrive in a collaborative environment and take ownership of delivering high\-quality solutions. *Work with amazing people and be part of a unique culture*