GenAI QA Automation Engineer-Manager

Overview

Lead the design and delivery of automated testing approaches for generative AI solutions, focusing on validation, test coverage, and dependable release cycles within the Data and Analytics Engineering practice at PwC Acceleration Center India.

What you'll do

• Develop and implement automated testing frameworks for data-driven solutions
• Leverage advanced analytics and statistical techniques to extract insights from complex datasets
• Collaborate with cross-functional teams to design and optimize data pipelines and workflows
• Utilize programming languages such as C++ and R for data modeling and predictive analysis
• Apply machine learning algorithms and neural networks to enhance data science projects
• Conduct exploratory and descriptive analysis to support strategic decision-making
• Build and maintain data visualizations to communicate insights effectively
• Troubleshoot data science workflows to improve data quality and accuracy
• Engage in continuous learning to stay updated with emerging technologies in artificial intelligence and data science
• Support client engagements by providing technical guidance and innovative solutions
• Coach teams, guide execution across workstreams, review deliverables, and manage priorities

What you'll need

• At least a Bachelor's and Master's degree
• At least 8 years of experience
• Oral and written proficiency in English

Nice to have

• Extensive hands-on expertise in Playwright automation with Python, including the design and maintenance of scalable automation frameworks using Pytest, Page Object Model (POM), fixtures, parameterization, and data-driven testing techniques
• Proven experience in REST API automation leveraging Python Requests, Pytest, Postman, and similar tools, with solid knowledge of HTTP methods, status codes, headers, JSON payloads, authentication, error handling, and API response validation
• Strong proficiency in SQL for backend testing, covering database validation, complex joins, stored procedures, data reconciliation, and ensuring data integrity across systems
• Skilled in automating diverse test scenarios, including functional, regression, integration, smoke, and end-to-end testing, aligned with Agile principles and best testing practices
• Comprehensive understanding of test planning, test case design, defect lifecycle management, debugging, root cause analysis, and driving quality assurance in dynamic development environments
• Experienced in using Git-based version control systems, performing code reviews, generating detailed test reports, and enforcing automation coding standards
• Hands-on experience testing LLM/Generative AI and retrieval-augmented generation (RAG) applications, focusing on prompt validation, response accuracy, hallucination detection, citation verification, and output consistency
• Proficient in leveraging AI-powered development tools such as Claude, Cursor, ChatGPT, and GitHub Copilot to accelerate automation scripting, debugging, SQL generation, API test creation, documentation, and overall engineering efficiency

Details

• Location: Bangalore