Senior Data Engineer

Senior Data Engineer – 8+ Years Experience Job Type: Full-Time Work Model: Hybrid Experience: 8+ Years Employment: Full-Time Job Summary We are looking for an experienced Senior Data Engineer with 8+ years of hands-on experience designing, developing, and maintaining scalable data platforms and data pipelines. The ideal candidate will have strong expertise in Python, SQL, ETL/ELT, cloud platforms, data warehousing, and distributed data processing . The candidate will work closely with Data Scientists, Software Engineers, Business Analysts, and other stakeholders to build reliable, high-performance data solutions and enable data-driven decision-making. Key Responsibilities • Design, develop, and maintain scalable ETL/ELT data pipelines . • Build and optimize data processing workflows using Python and SQL . • Develop data ingestion solutions from databases, APIs, files, and other sources. • Design and maintain enterprise data warehouses, data lakes, and lakehouse architectures . • Work with large datasets using distributed processing technologies such as Apache Spark/PySpark . • Develop data models and optimize complex SQL queries for performance. • Implement data quality, validation, monitoring, and error-handling frameworks. • Integrate data from structured and unstructured sources. • Build and maintain batch and real-time/streaming data pipelines. • Work with cloud data platforms such as AWS, Azure, or GCP . • Implement CI/CD and DevOps practices for data engineering workflows. • Collaborate with cross-functional teams to understand business and technical requirements. • Troubleshoot pipeline failures, performance issues, and data quality problems. • Ensure data security, governance, scalability, and compliance. • Mentor junior and mid-level data engineers and contribute to technical architecture decisions. • Document data pipelines, architectures, processes, and technical solutions. Required Skills • 8+ years of professional experience in Data Engineering or related roles. • Strong programming experience with Python . • Advanced SQL skills with experience in query optimization. • Strong experience with ETL/ELT development and data pipeline architecture. • Hands-on experience with Apache Spark / PySpark . • Experience with cloud platforms such as: • AWS – S3, Glue, Redshift, EMR, Lambda • Azure – Data Factory, Databricks, Synapse, ADLS • GCP – BigQuery, Dataflow, Cloud Storage • Strong understanding of data warehousing and dimensional data modeling . • Experience with relational databases such as SQL Server, PostgreSQL, Oracle, or MySQL . • Experience with Databricks and/or Snowflake is highly desirable. • Knowledge of Apache Kafka or other streaming technologies. • Experience with workflow orchestration tools such as Airflow, Azure Data Factory, or AWS Glue . • Familiarity with Git, CI/CD, Docker, and DevOps practices . • Strong understanding of data quality, governance, security, and metadata management. Preferred Qualifications • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field. • Experience designing enterprise-scale data architectures. • Experience with real-time data processing and streaming. • Experience with Terraform or Infrastructure as Code . • Familiarity with Kubernetes and containerized workloads. • Experience working in Agile/Scrum environments. • Strong communication, analytical, and problem-solving skills. Technical Environment Languages: Python, SQL, Scala/Java Big Data: Apache Spark, PySpark, Hadoop Cloud: AWS / Azure / GCP Data Warehousing: Snowflake, Redshift, Synapse, BigQuery Databases: SQL Server, PostgreSQL, Oracle, MySQL ETL/ELT: Databricks, AWS Glue, Azure Data Factory Streaming: Kafka, Spark Streaming Orchestration: Apache Airflow DevOps: Git, Jenkins/GitHub Actions, Docker, CI/CD Methodology: Agile/Scrum Work Arrangement This is a Full-Time Hybrid position. The selected candidate will be expected to work both remotely and from the designated office location based on business requirements. What We’re Looking For We are seeking a senior-level engineer who can independently own data engineering projects, contribute to architecture and design decisions, build production-grade pipelines, and collaborate effectively with technical and business teams.