Accion Labs - Lead Quality Assurance Engineer - Python

About the Role: We are looking for an experienced Lead QA - Python & AI to lead quality engineering initiatives, develop scalable automation frameworks, and ensure the reliability and performance of AI-powered applications. Key Responsibilities: - Lead end-to-end quality assurance activities, including test planning, test design, automation, execution, and reporting. - Design, develop, and maintain scalable test automation frameworks using Python. - Lead functional, regression, integration, API, and end-to-end testing. - Develop testing strategies for AI/ML applications, including model validation, accuracy, reliability, and performance testing. - Validate AI-generated outputs for correctness, consistency, bias, and unexpected behaviour. - Test AI/LLM-based applications, including prompt validation, response quality, and hallucination detection. - Integrate automated tests into CI/CD pipelines to support continuous testing. - Collaborate with developers, data scientists, ML engineers, and product teams to define quality standards. - Identify, investigate, and troubleshoot defects, perform root-cause analysis, and drive resolution. - Establish quality metrics, automation coverage, and reporting mechanisms. - Mentor QA engineers, review automation code, and promote best practices. Required Skills: - 10 - 14 years of experience in Quality Assurance or Test Automation. - Strong hands-on expertise in Python programming and frameworks like Pytest, Selenium, or Playwright. - Experience testing AI/ML-based applications and validating model outputs. - Knowledge of REST APIs, SQL, and test data management. - Experience with Git, CI/CD pipelines (Jenkins, GitHub Actions). - Experience leading QA teams and defining test strategies. Good to Have: - Experience with LLM testing and Generative AI applications. - Exposure to AI evaluation frameworks and cloud platforms (AWS, Azure, GCP). - Knowledge of performance testing tools and observability practices.