Data Engineer (ODIN)

The Role The Data Engineer will be deployed as part of the Data Engineering & Infrastructure team to support the operations, maintenance and enhancement of ODIN.

You will work under the direction of the Team Lead and alongside PSD officers, appointed vendors, source system owners and business users, providing hands-on data engineering capacity for ODIN's ingestion, transformation, data quality and downstream data services. The role is hands-on and delivery focused.

You will develop and maintain ETL pipelines and processing logic, work with existing ODIN data models and datasets, investigate legacy and inconsistent HR data, automate validation and operational processes, execute testing, maintain technical documentation, and enable reliable downstream consumption of HR data.

You are expected to work within established PSD processes, security requirements, technical standards and delivery priorities. Key decisions, stakeholder commitments and approvals remain with the relevant PSD officers and system owners.

Key Responsibilities

Data Pipeline & Interface Engineering: Develop and maintain ETL pipelines and file-based interfaces for ingesting HR data into ODIN, including data profiling, mapping, specifications and dataset onboarding.

Data Transformation & Modelling: Build and maintain SQL and Python logic to cleanse, standardise, transform and reconcile HR data into reliable, reusable datasets, including historical and legacy data.

Data Model & Dataset Maintenance: Enhance ODIN data models, tables and dependencies to meet new requirements, with traceable mappings, definitions and processing rules.

System Enhancements & Testing: Support CRs and SRs by reviewing requirements, executing tests, validating outputs, documenting defects and resolving issues through implementation.

Data Quality, Validation & Lineage: Automate validation, reconciliation and cleansing checks; investigate anomalies, trace lineage, resolve root causes and verify fixes. Pipeline Operations & Reliabil