Job Description
Position Summary: We are seeking a highly skilled and motivated Senior Data Engineer to join our team and play a crucial role in building and maintaining our common unified framework, data pipelines, data models, data products, and data engineering tooling. Position Responsibilities: Design, develop, and maintain a common unified data framework that enables seamless integration of data from various sources and systems. Create and optimize data pipelines for ingesting, processing, transforming, and storing large volumes of structured and unstructured data. Work closely with data scientists and analysts to understand their data requirements and translate them into robust data models. Develop and maintain data engineering tooling to improve data ingestion, data quality, data monitoring, and data governance processes. Troubleshoot and resolve data pipeline and data-related issues to ensure uninterrupted data flow. Monitor data pipeline performance, identify bottlenecks, and optimize data processing and storage for efficiency. Evaluate and integrate third-party data tools and technologies to enhance the data engineering capabilities of the organization. Experience applying AI or intelligent techniques to improve data quality, monitoring, or development workflows. Listed responsibilities are an essential, but not exhaustive list, of the usual duties associated with the position. Changes to individual responsibilities may occur due to business needs. Position Requirements: Proficiency in any object oriented or/and functional programming languages such as Python, Scala, or Java for data processing and data manipulation. Solid understanding of data quality, data governance, security, and lineage concepts. Strong ability to troubleshoot data-related issues effectively. Excellent communication and collaboration skills to work effectively with cross-functional teams. Demonstrated passion for data engineering, automation, and continuous learning All listed requirements are deeme
