Data Engineer

We are recruiting for a Data Engineer on behalf of one of the UK's most recognised and celebrated personal lines insurers. The successful candidate will join a collaborative team of data and AI engineers, scientists, developers, analysts, and architects. Together, they will design and build modern machine learning and AI services that support analytics and improve products across the business. It’s a chance to work on a very modern tech stack and learn from an incredible team. Key Responsibilities • Building and supporting data products within modern data platform. • Designing and delivering solutions with engineers, scientists and product teams. • Developing and optimising data pipelines across the analytics platform. • Integrating data from varied sources with strong quality standards. • Maintaining orchestration, monitoring and performance of data components. • Improving engineering processes across the wider data community. • Promoting high coding and data practice standards. • Experimenting with emerging data, ML and AI technologies. • Partnering with architects on data product designs. • Working collaboratively in multi-functional agile squads. • Supporting ML and GenAI infrastructure and workflows. Key Requirements • Passion for building scalable, resilient cloud data platforms. • Strong experience with Databricks or Snowflake on AWS. • Proven Python skills, including Spark and Airflow expertise. • Advanced SQL skills and end-to-end data modelling experience. • Experience building batch and real-time data integrations. • Hands-on CICD skills with Git, Jenkins or similar. • Ability to ingest, cleanse and structure large, diverse datasets. • Knowledge of Terraform or similar IaC tools. • Experience with Docker and Kubernetes is beneficial. • Exposure to production Generative AI is an advantage. • Strong collaboration skills and a proactive attitude. We do not retain any personal information without your permission. Please refer to our data protection policy on our official website for more information.