QA Engineer

Overview

QA Engineer responsible for defining and leading JazzX AI’s end-to-end quality strategy for AI-powered platforms and products, including agent workflows, LLM outputs, APIs, and cloud services.

What you'll do

• Build and own the end-to-end QA strategy across AI copilots, workflows, and enterprise deployments.
• Lead, mentor, and scale a team of QA engineers and automation specialists.
• Define and enforce quality gates and release-readiness standards.
• Develop evaluation systems for LLM accuracy, hallucination detection, factuality, safety, and bias mitigation.
• Architect and manage automation frameworks and integrate automated suites into CI/CD pipelines.
• Own release sign-off, conduct RCA, and drive continuous improvement in the QA lifecycle.
• Collaborate with DevOps/ML Ops on monitoring model drift and post-production behaviors.

What you'll need

• 3+ years of experience in Software QA.
• Hands-on experience with test automation frameworks and scripting in Python/Java/JavaScript.
• Experience working with microservice-based architecture.
• Working knowledge of AI/ML systems including datasets, model evaluation, vector stores, RAG, and LLM operations.
• Knowledge of Azure/AWS cloud architecture testing with automated API, microservices, and backend testing.
• Strong analytical and problem-solving skills to drive organization-wide quality initiatives.

Details

• Location: Bangalore, Karnataka.