UAT Tester - Mumbai

Overview

Senior QA Automation Engineer responsible for building scalable UI and API automation and validating AI-powered applications, Agentic AI workflows, LLM systems, and intelligent agents.

What you'll do

• Design and maintain UI and API automation frameworks with Playwright and TypeScript.
• Automate functional, regression, smoke, integration, and end-to-end scenarios.
• Test AI models, prompts, workflows, and autonomous agent behaviors.
• Develop evaluation frameworks for AI response quality, accuracy, reliability, safety, and performance.
• Integrate automation suites into CI/CD pipelines.
• Track defects, perform root cause analysis, and support issue resolution.
• Mentor junior QA engineers and contribute to automation best practices.

What you'll need

• 8–10 years of experience in software testing and automation.
• Strong expertise in Playwright with TypeScript.
• Hands-on experience testing Agentic AI, LLMs, AI agents, and evaluation frameworks.
• Experience automating REST API testing and validating request and response payloads.
• Experience preparing test plans, test cases, automation scripts, execution reports, and quality metrics.
• Ability to collaborate with developers, product owners, business analysts, and AI/ML teams.

Details

• Location: Mumbai, India; the description also lists Bangalore, Chennai, and Hyderabad.