Movate - Senior Data Engineer

Role : Senior Data Engineer - Hybrid Chennai Role Overview : We are seeking an experienced Senior Data Engineer to support a strategic SAP HANA to Snowflake Data Platform Modernization initiative. The ideal candidate should possess strong expertise in cloud data engineering, ELT/ETL pipeline development, data modeling, and Snowflake architecture. The Senior Data Engineer will be responsible for designing and validating scalable data ingestion and transformation frameworks, building proof-of-concept pipelines, establishing cloud-native engineering patterns, and collaborating with Data Architects, SAP HANA SMEs, BI teams, and business stakeholders to deliver a robust migration strategy. The role requires hands-on experience in designing enterprise data platforms using modern cloud technologies and Medallion Architecture. Key Responsibilities : - Design and develop scalable ELT/ETL pipelines to migrate data from SAP HANA to Snowflake. - Build Proof of Concepts (PoCs) to validate migration approaches, performance, and scalability. - Design and implement Medallion Architecture (Bronze, Silver, Gold) for enterprise data platforms. - Develop historical and incremental data loading frameworks using Change Data Capture (CDC) strategies. - Create reusable transformation logic using SQL, Python, PySpark, and dbt. - Design and optimize Snowflake objects including databases, schemas, virtual warehouses, stages, streams, tasks, and Snowpipe. - Implement Slowly Changing Dimensions (SCD Type 1 & Type 2) and dimensional modeling techniques. - Perform data profiling, data validation, reconciliation, and quality assessments. - Optimize SQL queries, ELT processes, and Snowflake compute/storage usage for performance and cost efficiency. - Evaluate and recommend data ingestion and orchestration tools such as dbt, Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow. - Collaborate with Data Architects and SAP HANA SMEs to define source-to-target mappings and transformation strategies. - Produce technical design documents, engineering standards, and implementation guidelines. - Mentor Data Engineers and participate in architecture reviews, code reviews, and Agile ceremonies. Required Skills : - Strong experience in Snowflake architecture, SQL, Snowpipe, Streams & Tasks, Virtual Warehouses, and performance optimization. - Hands-on expertise in SQL, Python, and PySpark for building scalable data pipelines. - Experience in ETL/ELT development, data transformation, and Change Data Capture (CDC). - Proficiency with dbt and exposure to tools such as Matillion, Fivetran, Azure Data Factory, AWS Glue, or Apache Airflow. - Strong understanding of Medallion Architecture, dimensional data modeling, and SCD Type 1 & Type 2. - Experience working with SAP HANA and migrating data to cloud data platforms such as Snowflake. - Knowledge of cloud platforms (AWS, Azure, or GCP) and cloud storage services. - Familiarity with Git, Azure DevOps, Jira, and Confluence. - Excellent analytical, problem-solving, communication, and stakeholder collaboration skills. Preferred Qualifications : - Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline. - Experience implementing enterprise-scale Snowflake solutions. - SnowPro Core Certification or equivalent is preferred. - Cloud certification (AWS, Azure, or GCP) is an added advantage. - Experience working in Agile/Scrum environments. Project-Specific Expectations : The Senior Data Engineer will support the project by designing and validating the target data engineering framework and should : - Design scalable ELT pipelines for SAP HANA to Snowflake migration. - Build prototype pipelines to validate migration strategies and architecture. - Implement Medallion Architecture and cloud-native engineering best practices. - Develop reusable transformation logic using SQL, Python, PySpark, and dbt. - Define CDC strategies, historical load frameworks, and incremental processing mechanisms. - Collaborate with Data Architects, SAP HANA Leads, and BI teams to ensure migration readiness. - Produce implementation-ready technical documentation, engineering standards, and migration recommendations. Nice to Have : - Experience with Snowpark. - Knowledge of AI/ML data engineering concepts. - Exposure to Large Language Models (LLMs), Prompt Engineering, or Retrieval-Augmented Generation (RAG). - Experience implementing DataOps or CI/CD pipelines for data platforms. - Experience working with globally distributed teams.