Custom Software Engineer - Python (Programming Language)

As a Custom Software Engineer, a typical day involves creating tailored software solutions by designing, coding, and improving various components within systems or applications. The role requires for a Python Developer with strong experience in data engineering, SQL, and Amazon Redshift.

The candidate will develop data pipelines, perform data transformations, and work with large datasets in an AWS environment. requires working with modern development frameworks and following agile methodologies to ensure the delivery of scalable and efficient software that meets unique business requirements.

Collaboration with different teams and continuous refinement of software elements are integral parts of the daily workflow, ensuring that solutions remain robust and adaptable to evolving needs.

Roles & Responsibilities

- Expected to be an SME, collaborate and manage the team to perform. - Engage with multiple teams and contribute on key decisions. - Provide solutions to problems for their immediate team and across multiple teams. - Develop and maintain Python-based ETL/ELT pipelines, write complex SQL queries for Amazon Redshift.

- Design and optimize Redshift tables, schemas, views, and queries, perform data extraction, transformation, validation, and loading, integrate data from APIs, databases, files, and cloud storage such as Amazon S3.

- Lead efforts to identify and implement best practices in software development to enhance team productivity and product quality. - Optimize Python and SQL code for performance and scalability, troubleshoot data pipeline failures and production issues, implement data quality checks and monitoring.

- Collaborate with data engineers, analysts, and business teams. Professional & Technical Skills: - Must To Have Skills: Proficiency in Python (Programming Language), advanced SQL and database concepts. - Strong knowledge of object-oriented programming concepts and design patterns.

- Hands-on experience with Amazon Redshift, ETL/ELT and data pipelines, Pandas and/or PySpark is beneficial- Good understanding of AWS services, especially S3, Redshift, Lambda, and IAM. - Understanding of data warehousing concepts: fact/dimension tables, star schema, partitioning, and incremental loads.

- Knowledge of Git and CI/CD practices. - Experience in debugging, testing, and optimizing software applications. Additional Information: - The candidate should have minimum 5 years of experience in Python (Programming Language). - This position is based at our Gurugram office.

- A 15 years full time education is required.