Sdet 3

Overview

Own quality across Bidgely's customer-facing products, including web dashboards, APIs, notifications, and GenAI solutions such as chatbots, voice IVR, and AI agents. This is a hands-on senior SDET role working closely with GenAI engineering, CX engineering, and product teams.

What you'll do

• Own the test strategy and release quality criteria for your product area.
• Build and maintain UI automation (using Selenium or Playwright), API automation, and end-to-end regression test suites.
• Design evaluation strategies for AI agents, utilizing LLM-as-judge, rubrics, and other assessment techniques.
• Create evaluation datasets and automated evaluation suites in Python, integrated with CI/CD pipelines.
• Test AI agents for accuracy, consistency, tool usage, safety, and data handling.
• Debug agent failures using LangSmith or similar AI observability tools.
• Analyze quality across releases to identify regressions.
• Review product requirements to pinpoint gaps in requirements and test coverage.
• Review test code, define testing standards, and mentor other SDETs.
• Communicate findings and recommendations with engineering, product, and leadership teams.

What you'll need

• 6–9 years of software testing experience, including hands-on SDET roles.
• Proficiency in both Python and Java.
• Experience owning test strategies and enhancing automation and release quality.
• Experience with UI automation tools such as Selenium or Playwright.
• Experience developing API automation and end-to-end frameworks within CI/CD.
• Ability to analyze product requirements and spot testing gaps.
• Strong analytical and communication skills.

Nice to have

• Previous experience testing chatbots, IVRs, and GenAI agents.
• Experience designing evaluations, rubrics, and LLM-as-judge assessments.
• Working knowledge of LangChain, LangGraph, LangSmith, or similar tools.
• Experience creating evaluation frameworks or tools for AI agents.

Details

• Location: India.

Tech you will work with

• Python, Java, Selenium, Playwright, REST API testing, Postman, TestNG, PyTest, LangChain, LangGraph, LangSmith, LLM evaluation, LLM-as-judge, RAG testing, AI agent testing, end-to-end testing, regression testing, CI/CD, GitHub Actions, Jenkins, AWS.