Overview
Serve as the technical lead for a team of engineers building enterprise-scale AI evaluation and platform capabilities, focused on AI/GenAI evaluation harnesses, scalable platform infrastructure, and production AI quality and observability.
What you'll do
- Lead complex model development and deployment pipelines, establishing best practices and driving innovation in data preparation and consumption.
- Integrate and optimize existing complex data and model pipelines in a production environment.
- Identify and diagnose data inconsistencies and errors, document assumptions, and forage to fill data gaps.
- Create self-running artificial intelligence (AI) systems to automate predictive models.
- Lead engineering design for complex batch and real-time data pipelines.
- Partner with data science teams to understand data requirements and perform data discovery for model development.
- Perform detailed analysis of raw data sources for data quality and model development needs.
- Engage with internal stakeholders to understand business processes, develop hypotheses, and translate requirements into an analytic approach.
- Write model monitoring scripts, diagnose root causes of monitoring alerts, triage issues, and coordinate responses to resolve them.
- Serve as a machine learning engineering subject matter expert on cross-functional teams for large strategic initiatives.
- Participate in special projects and perform other duties as assigned.
- Design advanced analytical protocols for mining large-scale datasets to uncover predictive patterns.
- Apply big data modeling techniques across domains such as market intelligence, advertising, and scientific research.
- Explore cutting-edge AI and data science frameworks to develop scalable machine learning architectures.
What you'll need
- Minimum 10 years of experience in machine learning engineering or advanced data science roles.
- Bachelor's degree (B.E./B.Tech) in Computer Science, Data Science, or AI/ML.
- Experience setting technical direction and mentoring engineers on complex AI/ML systems.
- Deep hands-on expertise building AI/GenAI evaluation, benchmarking, and evaluation harnesses.
- Expert Python and strong software/platform engineering fundamentals.
- AWS and cloud-native architecture design and implementation experience.
- Experience building LLM/GenAI systems, observability, monitoring, and production readiness.
- MLOps/LLMOps, CI/CD, APIs, and scalable distributed systems experience.
- Strong communication of technical tradeoffs to cross-functional partners and senior stakeholders.
Nice to have
- Master's degree or Diploma in a relevant technical field.
- Experience in regulated enterprise environments.
Details
- Location: Hyderabad, Telangana at Vanguard India.
- Only qualified external applicants will be considered.
- Hybrid working model for most employees.
Read the full description and apply on the company’s own careers page.