Azure Data Engineer (ID: 4098)

As an Azure Data Engineer, you will • Design, develop, and maintain scalable data pipelines using Microsoft Azure data services. • Develop data processing and transformation solutions using Python. • Build, configure, and manage data workflows using Azure Data Factory (ADF). • Develop and optimize data processing solutions using Azure Databricks and Apache Spark. • Integrate data from multiple sources using APIs and other data integration techniques. • Work with Azure Databricks and Azure data services to process, transform, and prepare data for analytics and reporting. • Implement data ingestion, transformation, and loading processes to support business requirements. • Monitor data pipelines, troubleshoot failures, and resolve data processing issues. • Optimize pipeline performance, reliability, and scalability. • Collaborate with cross-functional teams to understand data requirements and deliver effective technical solutions. • Follow coding standards, version control practices, testing procedures, and Agile ways of working. • Maintain technical documentation and support data platform improvements. What You Bring to the Table • 4–6 years of professional experience in data engineering, Azure data solutions, or related technical roles. • Hands-on experience with Microsoft Azure data engineering services. • Strong programming knowledge in Python for data processing and transformation. • Experience developing and maintaining data pipelines using Azure Data Factory. • Practical experience with Azure Databricks and Apache Spark. • Experience integrating data from external systems using APIs. • Understanding of data ingestion, transformation, ETL/ELT processes, and data integration concepts. • Knowledge of data pipeline monitoring, troubleshooting, and performance optimization. • Familiarity with Agile methodologies and collaborative development practices. • Strong analytical, problem-solving, and communication skills. You Should Possess the Ability to : • Develop reliable and scalable data pipelines using Python, Azure Data Factory, and Azure Databricks. • Extract, transform, and load data from different sources into target data platforms. • Build API-based integrations to ingest data from external applications and systems. • Process and transform large datasets using Databricks and Spark. • Troubleshoot pipeline failures, data quality issues, and performance bottlenecks. • Optimize data processing workflows to improve performance and reliability. • Collaborate with technical teams and business stakeholders to translate requirements into data engineering solutions. • Follow established development standards and participate in Agile development activities. • Document data pipelines, integration processes, and technical solutions. What We Bring to the Table • An opportunity to work on Azure-based data engineering projects. • Exposure to Python development, cloud data integration, and large-scale data processing. • Opportunities to contribute to data pipeline development and optimization. • Collaboration with technical teams in an Agile working environment. Let’s Connect Want to discuss this opportunity in more detail? Feel free to reach out. Recruiter : Giftson Paul Davidson Phone : +31 20 369 0609 ; Extn : 151 E-mail : giftson.p@stafide.nl LinkedIn : https://www.linkedin.com/in/giftsonpauldavidson/