AWS Data Engineer

Key Responsibilities Architecture & Design

• Design and architect the end-to-end AWS Data Lake and Lakehouse solution, including Landing Zone, Transformed Zone, and Curated/Consumption Zone layers

• Define and govern data architecture standards, patterns, and best practices across the platform

• Architect reusable data ingestion pipelines supporting REST APIs, JDBC databases, S3 file uploads, and SaaS connectors (e.g. Salesforce via AWS AppFlow)

• Design data storage strategies including hot, warm, and cold storage tiers, encryption, and data lifecycle policies Development & Deployment

• Develop and deploy data ingestion pipelines using AWS Glue, Lambda, Step Functions, Event Bridge, and API Gateway

• Build and maintain data transformation workflows (batch and stream processing) using AWS Glue and Amazon Redshift

• Implement orchestration, monitoring, logging, and notification frameworks for pipeline operations

• Develop and maintain the AWS Glue Data Catalogue, including schema evolution tracking and metadata tagging Security & Governance

• Configure and enforce data security policies using AWS Lake Formation, IAM, and Secrets Manager

• Implement granular access controls at database, table, and column levels

• Ensure compliance with data classification, retention, and audit requirements

• Support data quality frameworks and observability monitoring Maintenance & Operations

• Monitor platform health, performance, and pipeline reliability

• Troubleshoot and resolve data pipeline failures and data quality issues

• Maintain documentation for architecture decisions, pipeline configurations, and operational runbooks

• Continuously optimise platform performance and cost efficiency on AWS ________________________________________ Requirements Essential

• Minimum 3 to 5 years of experience in data engineering, data architecture, or cloud infrastructure roles

• Hands-on expertise with core AWS data services: Amazon S3, AWS Glue, Amazon Redshift, AWS Lambda, Amazon Kinesis, AW