Lead Gen-AI Engineer

Overview

Lead Gen-AI Engineer responsible for designing, testing, and deploying GenAI solutions that use LLMs and related technologies.

What you'll do

• Design, test, and deploy GenAI solutions leveraging LLMs.
• Implement prompt engineering, model evaluation, and retrieval-augmented generation (RAG).
• Set up continuous performance monitoring for ongoing optimization.
• Build CI/CD and other software engineering best practices into GenAI solutions.
• Develop evaluation scripts and perform load testing for LLM output randomness and robustness with third-party APIs.
• Implement RAG architecture components including data pipelines, vector databases, and search algorithms.

What you'll need

• Ability to rapidly prototype and test different models and approaches.
• Practical prompt engineering skills including prompt chains and prompt version management.
• Experience evaluating model and prompt performance with testing methodologies using training and test sets.
• Experience building production pipelines to monitor model responses and performance metrics.
• Knowledge of RAG architecture, including document chunking and embedding selection.
• Experience extracting data from sources such as PDF files for the RAG process.
• Experience developing data pipelines for ETL and integrating relational data when needed.

Details

• Location: Bengaluru.