Senior Test Engineer- Python

Position Description: Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com. Job Title: Test Engineer - Python Position: Test Engineer Experience: 6- 8 Years Category: Software Development/ Engineering Shift: UK Shift (Hybrid) Main location: Chennai, Bangalore, Hyderabad Position ID: J1026-0023 Employment Type: Full Time Education Qualification: Bachelor's degree in Computer Science or related field or higher with minimum 3 years of relevant experience. Position Description: We are looking for a Test Engineer with strong experience in data validation, ETL testing, and automated testing. The ideal candidate should be proficient in Python, PySpark, Pandas, SQL, and Apache Airflow DAGs, with hands on experience validating data pipelines, transformations, workflows, and data quality. The candidate will be responsible for designing and executing test strategies for data pipelines, validating source to target data, automating test scenarios, and ensuring data accuracy, completeness, consistency, and reliability. #LI-BK7 Your future duties and responsibilities: . Design and execute test cases for data pipelines, ETL/ELT workflows, and data transformation processes. . Validate data processing logic using PySpark, Python, Pandas, and SQL. . Perform source to target data validation, reconciliation, and data quality testing. . Develop automated test scripts using Python/PySpark to validate large datasets. . Test and validate Apache Airflow DAGs, including task dependencies, scheduling, retries, failures, and workflow execution. . Validate data transformations and business rules implemented in Spark/Python pipelines. . Perform data completeness, accuracy, consistency, uniqueness, and integrity checks. . Write complex SQL queries for data validation, reconciliation, and defect investigation. . Analyze test failures and perform root cause analysis across data, code, and pipeline workflows. . Create reusable test frameworks/utilities for data validation and regression testing. . Validate pipeline behavior for positive, negative, boundary, and exception scenarios. . Execute regression testing following changes to data pipelines or business logic. . Work closely with Data Engineers, Developers, Business Analysts, and other QA team members to resolve defects. . Monitor pipeline execution and investigate failures in Airflow DAGs. . Maintain test cases, test data, test scripts, and testing documentation. . Participate in Agile ceremonies including sprint planning, daily stand ups, reviews, and retrospectives. Required Technical Skills . Python: Strong hands on experience with scripting, automation, data validation, and test development. . PySpark: Experience validating Spark based data transformations and processing large datasets. . Pandas: Experience with DataFrame operations, data comparison, transformation, and validation. . SQL: Strong SQL skills including joins, subqueries, CTEs, aggregations, window functions, and data reconciliation. . Apache Airflow: Experience working with and testing DAGs, tasks, dependencies, schedules, retries, and failures. . Strong understanding of ETL/ELT concepts and data warehousing. . Experience with data quality and data reconciliation testing. . Familiarity with automation frameworks and writing maintainable test scripts. . Good understanding of SDLC and STLC processes. . Experience with Git/version control. Required qualifications to be successful in this role: Must Have: Python | PySpark | Pandas | SQL | Airflow DAGs | ETL/Data Testing | Data Validation | Automation Testing Good To Have Skills: . Experience with cloud data platforms such as AWS, Azure, or GCP. . Exposure to Databricks or other Spark based platforms. . Experience with CI/CD pipelines and DevOps practices. . Familiarity with tools such as Jira and test management platforms. . Knowledge of dimensional data modeling and data warehouse concepts. . Experience testing large volume datasets and distributed data processing. . Familiarity with PyTest or other Python testing frameworks. Skills: • Microsoft SQL Server • Pandas • Python • Banking • Generative AI What you can expect from us: Together, as owners, let’s turn meaningful insights into action. Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because… You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction. Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals. Come join our team—one of the largest IT and business consulting services firms in the world.