Data Operations Engineer

We are seeking a hands-on Data Operations Engineer (DataOps) to join our growing Data team and report to our Data Technical Lead. In this role, you will take ownership of the day-to-day health, reliability, and performance of our ETL/ELT data pipelines. You will ensure data flows accurately and efficiently across our platforms by monitoring pipeline performance, responding to issues, improving reliability, and creating greater visibility into how data moves through our environment. Working alongside data analysts, engineers, and IT teams, you will play a key role in supporting our Microsoft Fabric, Power BI, SQL, and PySpark environments. Your focus will be on operational excellence - ensuring issues are identified early, processes are well documented, and our data platform remains robust and scalable. As Abano continues to expand its use of AI-powered solutions, you will also contribute to supporting and improving AI services, copilots, and automation platforms built using Microsoft technologies. Key Responsibilities • Monitor the health and performance of ETL/ELT pipelines across Azure SQL Data Warehouse and Microsoft Fabric environments. • Investigate, troubleshoot, and resolve pipeline failures and data-quality issues to ensure reliable data delivery. • Identify recurring issues, performance bottlenecks, and opportunities to optimise data processes. • Develop and maintain monitoring, alerting, and notification frameworks to proactively identify issues. • Improve visibility of data flows, including pipeline dependencies, schedules, and data lineage. • Create and maintain clear documentation, operational runbooks, and data flow processes. • Implement data validation and reconciliation checks to maintain data accuracy and integrity. • Collaborate with the Data Technical Lead, data analysts, IT teams, and system owners to resolve data issues and support reporting requirements. • Support downstream Power BI reporting datasets and business intelligence solutions.