EXL - Microsoft Fabric Data Engineer

Role Overview : We are seeking a highly skilled Microsoft Fabric Data Engineer to design, develop, and maintain modern data platforms leveraging Microsoft Fabric. The ideal candidate should have hands-on experience with OneLake, Lakehouse, Data Factory, Data Pipelines, PySpark, SQL, and Medallion Architecture to support enterprise-scale analytics and reporting requirements. Key Responsibilities : Data Engineering & Integration : - Design, develop, and maintain scalable data ingestion and transformation pipelines using Microsoft Fabric. - Build and manage ETL/ELT workflows using Fabric Data Factory and Data Pipelines. - Integrate data from multiple sources including databases, APIs, flat files, cloud storage, and SaaS applications. - Implement incremental data loads and Change Data Capture (CDC) strategies. Lakehouse Development : - Design and maintain Fabric Lakehouse environments. - Develop and optimize Delta Tables for high-performance analytics workloads. - Implement Medallion Architecture (Bronze, Silver, Gold layers) to support data quality and governance requirements. - Create curated datasets for reporting, analytics, and AI/ML use cases. Data Transformation & Processing : - Develop data transformation logic using PySpark, Spark SQL, and notebooks. - Create reusable frameworks and data engineering best practices. - Perform data cleansing, enrichment, and standardization activities. Data Modeling & Analytics Support : - Design dimensional and analytical data models. - Collaborate with Business Intelligence teams to support Power BI semantic models and reporting requirements. - Ensure data consistency, quality, and accuracy across data platforms. Performance Optimization & Governance : - Monitor data pipeline performance and troubleshoot production issues. - Optimize Spark jobs, Lakehouse storage, and query performance. - Implement security controls, role-based access, and data governance standards. - Support data lineage, auditing, and compliance requirements. DevOps & Collaboration : - Implement CI/CD processes using Git integration and deployment pipelines. - Participate in Agile ceremonies and collaborate with architects, analysts, and business stakeholders. - Maintain technical documentation and operational runbooks. Required Skills : Technical Skills : - Microsoft Fabric - OneLake - Fabric Lakehouse - Fabric Data Factory - Data Pipelines - Notebook Development - PySpark - Spark SQL - SQL - Delta Lake - Medallion Architecture - Power BI Integration - Git Version Control Cloud & Data Platform Experience : - Azure Data Services - Azure Data Lake Storage (ADLS) - Azure Synapse Analytics (preferred) - Azure DevOps Data Engineering Concepts : - ETL/ELT Development - Data Modeling - Data Warehousing - Data Governance - Data Quality Frameworks - Performance Tuning Preferred Qualifications : - Experience in large-scale enterprise data transformation programs. - Knowledge of Data Mesh and Modern Data Platform concepts. - Exposure to AI/ML data preparation processes. - Microsoft Fabric Certification (Preferred). - Experience working in Banking, Insurance, Healthcare, or Retail domains.