Associate Software Engineer

Overview

Early-career engineering role on an AI engineering team building LLM-based systems, focused on evaluating the correctness of AI/LLM outputs and modelling extracted information as structured knowledge (entities and relationships).

What you'll do

• Build and extend LLM evaluation harnesses, including golden datasets, precision/recall/F1, calibration, and LLM-as-judge scoring.
• Design and work with knowledge graphs, including entity-relationship modelling, graph traversal/queries, and embeddings-based similarity and retrieval.
• Build GenAI/LLM pipelines in Python, covering prompting, RAG, and structured output.
• Write clean, tested code, collaborate with senior engineers, and document your work.
• Act in accordance with and as a good steward of Duck Creek Technologies' mission, vision, and core values.

What you'll need

• B.Tech/M.Tech with an AI/ML specialization, or CS/IT with strong, demonstrable AI coursework/projects.
• 0 to 2 years of experience.
• Strong Python fundamentals and a solid grasp of data structures and algorithms.
• Working understanding of LLM fundamentals: prompting, embeddings, RAG, and basic evaluation concepts.
• A maintained personal GitHub profile with at least one substantive AI/LLM project (academic or personal), not a cloned tutorial. Share your resume along with your GitHub profile link. Applications without a working GitHub link showing original project work will not be considered.

Nice to have

• Exposure to evaluation frameworks/metrics for generative AI (e.g. Ragas, DeepEval, or a self-built LLM-judge approach).
• Exposure to knowledge graphs / graph data structures (NetworkX, Neo4j, RDF/OWL, or a well-reasoned custom graph model in a project).
• Any agent framework (LangChain/LangGraph or similar), vector databases, any cloud platform, and REST API basics (FastAPI/Flask).

Details

• Location: Bengaluru, India. This role is aligned to a specific location, and you are expected to reside within reasonable proximity to that location.
• Work arrangement: work may be performed remotely at the start of employment, subject to business needs and company guidelines; you may later be expected to transition to a hybrid arrangement, including working from a designated office on a schedule set by your leader.
• Expected to participate in in-person moments that support team connection, collaboration, and business priorities.
• Candidates must complete all interviews based on their own knowledge and experience; the use of AI tools during interviews is not permitted.