Senior Principal Engineer - IT Quality & Assurance Testing

Overview

Lead Quality Engineering and IT assurance testing across traditional software and AI-powered applications. Drive scalable automation, AI/LLM evaluation, testing strategy, and quality outcomes while managing QA teams.

What you'll do

• Drive a Quality Engineering mindset across software and AI-powered applications.
• Define testing strategies for web/UI, API, database, AI/LLM, RAG, and AI-powered applications.
• Build and maintain scalable automation frameworks.
• Lead manual, automation, and AI/LLM testing activities.
• Manage, mentor, and develop QA and Quality Engineering teams.
• Evaluate emerging technologies and introduce effective testing solutions.
• Integrate test automation with GitHub and CI/CD pipelines.

What you'll need

• 7+ years of experience in software testing or Quality Engineering.
• Experience managing end-to-end project delivery and leading QA teams.
• Strong knowledge of STLC, SDLC, Agile, test strategy, risk management, defect management, and quality metrics.
• Strong automation experience with Python, JavaScript/TypeScript, Java, Playwright, Selenium, and WebdriverIO.
• Knowledge of UI, API, SQL/database, and data validation testing.
• Experience with AI/LLM testing, RAG, and AI-powered applications.
• Strong communication, stakeholder management, analytical, problem-solving, and people leadership skills.

Nice to have

• Experience with PromptFoo, Ragas, DeepEval, LangSmith, PyRIT, or similar tools.
• Knowledge of embeddings, vector databases, semantic search, retrieval, and reranking.
• Experience with generative AI, prompt engineering, AI agents, and AI safety testing.
• Knowledge of AI security risks including prompt injection, jailbreaks, hallucination, data leakage, and guardrails.
• Experience with GitHub Actions and CI/CD pipeline integration.

Details

• Hybrid role requiring at least three days per week in the office.
• Locations stated in the description include Gurugram, Noida, and Pune.