Data Engineering Mid\-level Lisboa, Braga, Viana do Castelo Complex problems require the right expertise! One of the biggest challenges today is the proper storage and processing of data considering these three domains (3Vs): Volume, Velocity, and Variety. At Xpand IT, the Data Engineering team develops and implements software architectures and solutions that handle the capture, ingestion, storage, and management of critical data from large information clusters where the 3Vs are always present. We leverage a set of advanced frameworks such as Spark, Kafka, Hive/Impala, Azure Data Services, or MongoDB, using Java and Scala as programming languages to interact with these frameworks. Main Responsibilities As a Data Engineer, it is essential to work closely with Platform Engineers to develop software solutions, applying best practices in terms of design and architecture of large\-scale distributed systems. The main responsibilities involve ensuring the performance and scalability of software interacting with backend Big Data systems, contributing to maintaining the overall system performance. **Key daily responsibilities:** Implement solutions in distributed architectures where performance in processing large volumes of data is crucial Design and develop robust and scalable software solutions regardless of the amount of data to be processed Implement best practices and design patterns for Big Data solutions in the software produced Analyze complex problems requiring efficient solutions to manipulate large amounts of information Develop models and organization of data structures that optimize "search" and "storage" operations in large\-scale distributed systems Design and develop communication APIs between backend Big Data systems and external systems through standard communication protocols **Stacks:** Python, Java/Scala, Spark, Kafka/Confluent, MongoDB, Databricks Requirements Academic Background Bachelor's and/or Master's degree in Computer Science, Information Systems, or related field. Experience with Java/Scala Experience with Java\-based technologies (JBoss, Spring, Spring MVC, Hibernate) and defining communication interfaces using standards such as XML, JSON, SOAP. Design Patterns Experience implementing design patterns in advanced software solutions (multi\-threaded, multi\-process, multi\-cloud). Databases Experience with relational and non\-relational databases (SQL, MySQL, NoSQL, Hadoop, MongoDB). Development Tools Extensive experience using tools such as Eclipse, Maven, Jenkins, GIT, JIRA, or equivalents. Languages Proficiency in English, both spoken and written. **Nice to have:** Knowledge or experience using distributed computing/storage frameworks such as Apache Spark, Kafka, or native cloud solutions like Databricks, EMR, or DataProc; Team player and problem\-solving skills.