Consultant Data Engineer, Microsoft Fabric

Data Engineer Microsoft Fabric Job Title: Consultant Data Engineer Microsoft Fabric Location: Calgary, AB, Canada - Remote Employment Type: 6 Month to Hire Job Summary Lantern is seeking a Consultant Data Engineer Microsoft Fabric to help design, build, and modernize data platforms for clients using the Microsoft data ecosystem. This is a hands-on data engineering role focused on data ingestion, transformation, Lakehouse development, data modeling, and reporting enablement . The ideal candidate will have experience working with Microsoft Fabric, OneLake, Lakehouse, Warehouse, Data Factory, SQL, Python, Spark, and Power BI . The Consultant Data Engineer will work closely with architects, senior consultants, delivery managers, and client stakeholders to deliver scalable, secure, and well-governed data solutions. The role will also support modernization initiatives that move clients from legacy data platforms and fragmented reporting environments toward modern Microsoft Fabric-based solutions. Key Responsibilities • Design, build, test, and maintain data pipelines and transformations using Microsoft Fabric Data Factory, Dataflows, Notebooks, SQL, Python, and Spark . • Build and enhance Fabric Lakehouse and Warehouse solutions using Medallion Architecture across Bronze, Silver, and Gold layers. • Ingest and integrate data from databases, files, APIs, cloud platforms, and business applications. • Develop reusable, modular, scalable, and maintainable data engineering solutions supporting analytics, reporting, operational insights, and AI use cases. • Support data modeling and semantic layer development in collaboration with architects, senior consultants, and Power BI developers. • Implement data validation, reconciliation, data quality checks, monitoring, and error handling throughout ingestion and transformation processes. • Optimize SQL, Spark, pipeline, and notebook workloads for performance, reliability, cost efficiency, and maintainability. • Document technical designs, data flows, transformation logic, assumptions, and operational procedures. • Collaborate with client technical teams and business stakeholders to understand requirements, resolve data issues, and support technical decisions. • Participate in Agile delivery activities including backlog refinement, sprint planning, demos, retrospectives, and status updates. • Support migration and modernization initiatives from SQL Server, Azure Synapse, SSIS, Databricks, Snowflake , and legacy reporting/ETL environments into Microsoft Fabric. • Contribute to data governance practices including workspace organization, access controls, naming standards, lineage, and secure-by-design implementation. • Stay current with Microsoft Fabric capabilities and contribute recommendations and best practices to delivery teams. Required Qualifications • 2+ years of hands-on data engineering experience , preferably in consulting or client-facing environments. • Experience building data pipelines, transformations, and data models using SQL and at least one programming language such as Python . • Working knowledge of Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks , or comparable cloud data platforms. • Experience with Lakehouse, Data Warehouse, or Medallion Architecture concepts. • Strong SQL skills including data transformation, troubleshooting, query optimization, and data validation. • Familiarity with Spark, Delta Lake, Notebooks , or distributed data processing technologies. • Experience working with structured and semi-structured data from multiple source systems. • Understanding of ETL/ELT, batch ingestion, incremental loads, and data orchestration . • Ability to create clear technical documentation and communicate delivery progress, blockers, and risks. • Strong collaboration skills with architects, consultants, project teams, and client stakeholders. • Experience working in Agile delivery environments with backlog-driven priorities and regular demonstrations. • Bachelor's degree in Computer Science, Data Engineering, Information Systems, Analytics, or a related field, or equivalent practical experience. Preferred Qualifications • Hands-on experience with Microsoft Fabric Lakehouse, Warehouse, OneLake, Data Factory, Notebooks, Dataflows Gen2, and Deployment Pipelines . • Experience with Power BI Semantic Models, DAX, Power Query , or analytics/reporting enablement. • Exposure to Microsoft Purview , data governance, security, data lineage, or data cataloging. • Experience with dbt, Git, Azure DevOps, CI/CD, automated testing , or analytics engineering practices. • Experience modernizing workloads from Azure Synapse, SSIS, SQL Server, Snowflake, Databricks , or legacy ETL platforms into Microsoft Fabric. • Exposure to AI-enabled data solutions including Microsoft Foundry, Azure AI Foundry, Copilot Studio, Fabric Data Agents , natural language querying, or agent-assisted analytics. • Exposure to machine learning, feature engineering, ML data preparation, Azure Machine Learning, MLflow , or collaboration with data science teams. • Experience working with unstructured or semi-structured data for AI, search, document intelligence, or content understanding use cases. • Microsoft certifications such as Fabric Analytics Engineer Associate, Azure Data Engineer Associate, or Power BI Data Analyst Associate are a plus.