Overview
Senior Associate, Automation Engineer AI, in PwC's Advisory line of service, to validate and ensure the quality, reliability and performance of AI-powered applications and Large Language Model (LLM) solutions.
What you'll do
- Design, develop and maintain scalable test automation frameworks using Playwright.
- Create automated test scripts using TypeScript, JavaScript or Python.
- Validate AI/LLM-based applications, including prompt testing, response evaluation, hallucination detection and output consistency checks.
- Implement AI-driven testing practices across the Software Testing Life Cycle (STLC).
- Develop strategies for validating non-deterministic AI responses and model behavior.
- Design and execute functional, regression, integration, API and end-to-end tests.
- Integrate automated test suites into CI/CD pipelines using tools such as Jenkins, GitLab CI or Azure DevOps.
- Collaborate with developers, product teams and AI engineers to ensure high-quality releases.
- Analyze test results, identify defects and provide actionable recommendations.
- Continuously enhance automation frameworks and testing processes.
What you'll need
- Strong hands-on experience with Playwright.
- Proficiency in TypeScript, JavaScript or Python.
- Practical experience implementing AI within STLC.
- Hands-on experience in AI Model Testing / LLM Testing.
- Experience validating non-deterministic AI responses.
- Strong programming and scripting skills.
- Experience building and maintaining automation frameworks from scratch.
- Solid understanding of SDLC/STLC, Agile methodologies and testing best practices.
- Experience with CI/CD tools such as Jenkins, GitLab CI or Azure DevOps.
- Strong knowledge of Git and version control systems.
- Excellent analytical, problem-solving and communication skills.
- 4 to 8 years of experience required.
- Education: BE/B.Tech/MBA/MCA; degrees/field of study required: Master of Engineering, Bachelor of Engineering.
Nice to have
Details
- Location: Bengaluru Millenia.
- Visa sponsorship: not offered.
- Government clearance: not required.
- Job posting end date: August 5, 2026.
Read the full description and apply on the company’s own careers page.