Backend Engineer, AI Engineering: Duo Chat

Overview

Backend Engineer on the Chat Engine team, building the engine behind GitLab Duo Chat’s conversational AI experience.

What you'll do

• Develop secure, well-tested, performant features for GitLab Duo Chat.
• Implement and extend agentic flows in Python using LangGraph, via Flow Registry and served by Duo Workflow Service.
• Integrate Chat capabilities with the GitLab Rails monolith, including its GraphQL API.
• Write maintainable code with tests for every merge request and follow internal standards for a high-scale environment.
• Review code per Code Review Guidelines and respond promptly to contributions.
• Identify technical debt and propose and implement efficiency improvements.
• Participate in Tier 2/Tier 3 on-call rotations to troubleshoot product and security operations and urgent engineering issues.

What you'll need

• Professional experience with Python, including building and testing production services.
• Working proficiency with Ruby on Rails, or willingness to learn it.
• Exposure to or interest in building on large language models (prompting, tool/function calling, evaluation, failure modes).
• Experience designing and building APIs, including diagnosing/optimizing performance issues and working with well-documented third-party services.
• A security-minded development approach applying secure coding guidelines early.
• Clear written communication suitable for a remote, largely asynchronous environment.
• Experience with LangGraph, LangChain, or a comparable agent orchestration framework.

Details

• Remote, largely asynchronous environment (role description states all roles are remote).
• Participates in weekday, weekend, and occasional night on-call rotations (Tier 2 or Tier 3).