Lead Data Engineer

Description Bristlecone India Limited is seeking a seasoned Lead Data Engineer to spearhead the design, development, and delivery of robust data platforms within our Data Services - Delivery department. The role involves architecting scalable pipelines, optimizing Snowflake data warehouses, and leveraging Databricks for advanced analytics. You will mentor a team of engineers, collaborate with cross‑functional stakeholders, and ensure data solutions meet performance, security, and compliance standards. Responsibilities • Architect and implement end‑to‑end data pipelines on Snowflake and Databricks. • Lead a team of data engineers, providing technical guidance and mentorship. • Design data models and schemas that support business intelligence and analytics. • Optimize query performance and cost efficiency in Snowflake environments. • Develop and enforce data governance, security, and compliance best practices. • Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions. • Implement CI/CD processes for data workflows and infrastructure as code. • Monitor, troubleshoot, and resolve production data pipeline issues. • Stay current with emerging data technologies and recommend strategic improvements. • Prepare technical documentation and present solution architectures to leadership. Qualifications • 10+ years of professional experience in data engineering or related fields. • Deep expertise in Snowflake architecture, performance tuning, and data warehousing. • Strong hands‑on experience with Databricks, Spark, and lakehouse concepts. • Proficiency in SQL, Python, and/or Scala for data transformation. • Demonstrated ability to lead and mentor technical teams. • Experience with cloud platforms (AWS, Azure, or GCP) and associated services. • Knowledge of data modeling, ETL/ELT design patterns, and data governance. • Familiarity with CI/CD tools (e.g., Git, Jenkins, Azure DevOps) and IaC (Terraform, CloudFormation). • Excellent problem‑solving, communication, and stakeholder management skills. • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related discipline.