Sr. Data Engineer

About Us: Artic Consulting is a dynamic IT and consulting services firm, delivering digital transformation through innovative solutions in data, cloud, and business analytics. We are seeking a skilled Data Engineer with a strong focus on the Microsoft Fabric ecosystem and Application Database management, who can design and implement scalable data solutions for our clients. Key Responsibilities: • Hands-on experience building and maintaining OLTP databases, including relational data modeling, schema design, normalization, SQL query development, indexing, transaction handling, performance troubleshooting, and data integrity controls • Design, develop, and maintain Power BI reports, dashboards, DAX expressions, KPIs, and scorecards using both Import and DirectQuery modes. • Build and orchestrate scalable ETL/ELT workflows using Fabric Data Pipelines, Dataflows Gen2, and Azure Data Factory. • Write and tune complex T-SQL and KQL queries, stored procedures, and views for performance in Synapse SQL and SQL Server environments. • Implement data models based on star/snowflake schemas and support modern data warehousing and Lakehouse architectures using Microsoft Fabric. • Manage and optimize Azure SQL application databases, including schema design, indexing strategies, stored procedures, query optimization, data integrity, security, monitoring, backup/recovery awareness, and operational reliability for client-facing business applications. • Partner with application, analytics, and client teams to ensure Azure SQL transactional databases are performant, secure, well-structured, and ready for integration with reporting, data warehousing, Microsoft Fabric, and AI/ML workloads. • integrate structured and unstructured data sources (e.g., SQL, Excel, APIs, Blob Storage), and transform them efficiently using Fabric Notebooks (Spark/PySpark) or Dataflows. • Diagnose and resolve pipeline failures, logic errors, and performance bottlenecks across the data engineering lifecycle. • Automate repetitive data processes using Azure Functions, Logic Apps, PowerShell, or Python scripting within the Fabric ecosystem. • Collaborate with stakeholders to gather business requirements and translate them into scalable data solutions. • Ensure data governance, privacy, and compliance standards (e.g., GDPR, HIPAA, ISO) are adhered to, including sensitive data handling policies. • Apply best practices for item-level security, workspace-based access models, and data lineage using Microsoft OneLake and Fabric tools. • Utilised AI-assisted tools such as GitHub Copilot and Microsoft Copilot to accelerate SQL development, data pipeline implementation, code reviews, troubleshooting, and performance optimization. • Support AI initiatives by preparing, transforming, and managing high-quality datasets for model training and inference. • Integrate AI-powered services such as Azure AI Services, Azure OpenAI, and Microsoft Fabric AI capabilities into data solutions. • Develop and maintain data pipelines that support Generative AI, predictive analytics, and machine learning workloads. Required Qualifications: • Bachelor's or master's degree in computer science, Information Systems, or related field. • Demonstrated hands-on experience in Power BI development and data engineering, including building enterprise dashboards and semantic models, developing DAX calculations, implementing ETL/ELT pipelines, integrating multiple data sources, optimizing data models and queries, and supporting production data workloads. • Strong expertise in T-SQL and KQL, with demonstrated query optimization skills. • Hands-on experience managing Azure SQL Database environments, including performance tuning, index optimization, stored procedures, query troubleshooting, database security, and operational support for application workloads. • Proficiency in Microsoft Fabric tools: Data Pipelines, Dataflows Gen2, OneLake, Notebooks. • Hands-on experience with Spark/PySpark and data integration from varied sources. • Microsoft Certified: Fabric Data Engineer Associate (DP-700) – preferred for candidates specializing in Microsoft Fabric. • Additional Microsoft certifications such as PL-300 (Power BI Data Analyst Associate) or relevant Azure certifications are an advantage. Preferred Skills: • Experience debugging and optimizing advanced SQL queries, database objects, and legacy components. • Ability to implement database security models and data protection policies. • Experience using Azure SQL monitoring and tuning capabilities such as Query Store, Query Performance Insight, Database Advisor recommendations, and Azure portal metrics to identify and resolve performance bottlenecks. • Expertise in implementing row-level security, dynamic data masking, and role-based access control within Microsoft Fabric and Power BI environments. • Familiarity with Microsoft OneLake architecture, including data cataloging, lineage tracking, item-level security, and workspace-based access management. • Proven ability to operate effectively in dynamic, client-facing environments, delivering scalable and compliant data solutions with a focus on performance and quality. Why Join Artic Consulting? • Competitive salary and performance-based bonuses. • Flexible working hours and remote work options. • Opportunities for professional development and certifications. • Collaborative and inclusive work environment. • Training budget for learning new skills and technologies.