Azure Data Engineer

About the Role: KPI Partners is seeking a skilled Azure Data Engineer with expertise in data engineering, cloud solutions, and experience with data pipeline development using Azure services. You will play a key role in designing and implementing scalable data solutions that drive insights and business decisions for our clients. Key Responsibilities: - Design, develop, and maintain data pipelines. - Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver high-quality data solutions. - Optimize data workflows for performance and scalability within the Azure environment. - Ensure data quality, integrity, and security throughout the data lifecycle. - Monitor and troubleshoot data processing issues to maintain smooth operations. - Document processes, architectures, and data models for knowledge sharing and compliance. - Stay updated with the latest trends and technologies in data engineering and cloud computing. Mandatory Skills : - ADF, SQL, Pyspark, Python, Databricks Qualifications : - Bachelor's degree in Computer Science, Data Science, Engineering, or a related field. - Proven 6+ years of experience as a Data Engineer, with a focus on ADF, Pyspark, Python, and SQL. - Proficiency in SQL and experience with programming languages such as Python or Scala. - Familiarity with Azure data services, including Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics. - Strong analytical and problem-solving skills with attention to detail. - Excellent communication and collaboration skills to work effectively across teams.