Data Engineer - Google Cloud Platform

Mandatory Skills : - Google Cloud Platform (GCP) - Scala - Data Engineering - BigQuery - Apache Spark - Cloud Dataflow - Apache Beam - SQL - ETL/ELT Pipelines - Git Job Summary: We are looking for a skilled Data Engineer - Data Platforms (Google Cloud | Scala) to design, develop, and optimize scalable data platforms and pipelines on Google Cloud Platform (GCP). The ideal candidate should have strong expertise in Scala, distributed data processing, cloud-native technologies, and modern data engineering practices. You will work closely with data architects, analysts, and cross-functional teams to build reliable, high-performance data solutions that support business intelligence, analytics, and machine learning initiatives. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Scala and Google Cloud Platform (GCP). - Build batch and streaming data processing solutions using Apache Spark, Cloud Dataflow, and Apache Beam. - Develop and optimize data models and datasets in BigQuery. - Design and implement robust ETL/ELT workflows for structured and unstructured data. - Integrate data from multiple internal and external sources. - Optimize data processing performance, scalability, and cost on GCP. - Ensure data quality, governance, security, and compliance across data platforms. - Monitor, troubleshoot, and resolve production data pipeline issues. - Collaborate with Data Scientists, Data Analysts, DevOps Engineers, and Product teams. - Participate in Agile ceremonies, sprint planning, code reviews, and technical discussions. Required Skills : - Strong hands-on experience with Google Cloud Platform (GCP). - Excellent programming skills in Scala. - Experience with Apache Spark for large-scale data processing. - Strong knowledge of BigQuery, Cloud Storage, and Cloud Dataflow. - Experience building batch and real-time data pipelines. - Strong SQL skills and experience with relational databases. - Knowledge of Apache Beam and event-driven data processing. - Experience with version control systems such as Git. - Understanding of CI/CD pipelines and DevOps practices. - Familiarity with data modelling, data warehousing, and distributed systems. - Strong analytical and problem-solving skills. Preferred Qualifications : - Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field. - Google Cloud Professional Data Engineer certification is a plus. - Experience with Airflow, Dataproc, Pub/Sub, or Kafka is an advantage. - Knowledge of Python or Java is desirable. - Experience working in Agile/Scrum environments. - Excellent communication and collaboration skills.