Sdet 3

Overview

Senior SDET role owning quality across customer-facing products, including web dashboards, APIs, notifications, and GenAI products such as chatbots, voice IVR and AI agents.

What you'll do

• Own test strategy and release quality criteria for your product area.
• Build and maintain UI automation (Selenium or Playwright), API automation and end-to-end regression suites.
• Design evaluation strategy for AI agents using LLM-as-judge, rubrics and other eval techniques.
• Build eval datasets and automated evaluation suites in Python, integrated with CI/CD.
• Test AI agents for accuracy, consistency, tool usage, safety and data handling.
• Debug agent failures using LangSmith and similar AI observability tools.
• Analyse release-over-release quality and identify regressions.
• Review product requirements and identify gaps in requirements and test coverage.
• Review test code, set testing standards and mentor SDETs.
• Communicate findings and recommendations to engineering, product and leadership.

What you'll need

• 6–9 years in software testing, including hands-on SDET experience.
• Good working knowledge of both Python and Java.
• Experience owning test strategy and improving automation and release quality.
• Experience with UI automation using Selenium or Playwright.
• Experience building API automation and end-to-end frameworks with CI/CD.
• Ability to analyse product requirements and identify testing gaps.
• Prior experience testing chatbots, IVRs and GenAI agents.
• Experience designing evals, rubrics and LLM-as-judge evaluations.
• Working knowledge of LangChain, LangGraph and LangSmith or similar tools.
• Experience building eval harnesses or tooling for AI agents.
• Strong analytical and communication skills.

Details

• Location: India (Bengaluru engineering center).
• Hands-on engineering role working closely with GenAI engineering, CX engineering and product teams.