Overview
Build and evaluate agentic AI systems for Alation’s Content & Enablement Systems within Digital Customer Experience.
What you'll do
- Design and ship end-to-end agentic workflows including orchestration, retries, guardrails, and evaluation harnesses.
- Create evaluation loops to catch failures before they reach production.
- Operate retrieval infrastructure covering indexing strategy, relevance tuning, and diagnosing retrieval degradation.
- Integrate MCP servers and APIs as part of system design.
- Build systems that efficiently route AI-generated content for human review via quality gates.
- Partner with Product Management, Product Marketing, Support, and field teams throughout the build.
What you'll need
- 3–5 years of relevant software engineering experience building agentic AI systems, RAG pipelines, or similar retrieval-augmented applications.
- Systems-first mindset for designing modular AI agents that scale across disparate data sources.
- Experience mapping complex end-to-end agentic workflows and anticipating failure modes.
- Experience with search/retrieval infrastructure such as indexing, ranking, or relevance tuning.
- Familiarity with API integration and/or MCP (Model Context Protocol) server integration.
- Strong ability to work cross-functionally to translate business content needs into technical systems.
- Judgment on when AI output needs human review versus autonomous shipping.
Nice to have
- Experience in a fast-moving product company environment.
- Prior experience with content/documentation pipelines, developer enablement tooling, or knowledge-management systems.
- Experience with drift-detection or sync systems between code and documentation.
- Familiarity with evaluation frameworks/tooling for LLM-based agents.
Read the full description and apply on the company’s own careers page.
