Sr. Software Engineer_Cloud_Devops

Key responsibilities: • Ensure the stability, scalability, and performance of the data pipelines solution. • Monitor and maintain batch data pipelines in a cloud-based environment. • Improve operational processes including incident handling, performance monitoring, and issue resolution. • Optimize Databricks workloads to improve efficiency and reduce costs. · Analyze and fine-tune the cloud infrastructure for better cost optimization. Technical Skills: • Solid understanding of common issues in cloud-based data pipelines and analytics solutions • Working knowledge of Databricks and Lakehouse architecture in a cloud environment. • Working with Batch accounts, IAC, GitHub, IAM, and CI/CD pipelines • Experience with command-line scripting (e.g., PowerShell ). • Experience with data pipeline orchestration tools (e.g. Azure Data Factory) • Understanding of monitoring and logging tools is a plus. Soft Skills: • Excellent problem-solving and critical thinking skills, with a proactive approach to incident management and root cause analysis. • Strong communication and coordination abilities, capable of working effectively across cross-functional and international teams. • High level of ownership, with a strong drive for operational excellence, efficiency, and continuous improvement.