Oscilar logo

Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)

Oscilar
NewPosted today

LOCATION

United States · Remote

EXPERIENCE

Not specified

TYPE

FullTime

SKILLS REQUIRED

Technical LeadershipLLM Agent DevelopmentAgent EvaluationReliability Engineering

Job description

Overview

Lead a team of engineers building and operating production AI agent systems for Oscilar's Agentic Risk Platform, owning both technical and people leadership.

What you'll do

  • Build, lead, and grow a high-performing team of engineers focused on AI agent systems, hiring, coaching, and developing talent.
  • Drive design, development, and continuous improvement of production agent capabilities including orchestration, tool-calling (including MCP and related protocols), evaluation frameworks, reliability, observability, and safe failure modes.
  • Raise the bar on architecture, design quality, reliability, and service ownership for agent systems operating in high-stakes, regulated environments.
  • Partner with Forward-Deployed Engineers and customer teams to ship agents into customer environments and turn field feedback into platform improvements.
  • Establish clear planning, execution, and incident processes that support predictable delivery, and own reliability and post-incident learning for agent systems.
  • Recruit senior individual contributors and emerging leaders, and create an environment where strong engineers want to stay and grow.
  • Ensure AI agent systems meet the performance, security, auditability, and reliability standards required by financial institutions.

What you'll need

  • Significant hands-on software engineering experience, with a track record of shipping production systems.
  • Proven experience building and shipping agent systems in production, including hands-on work with tool-calling, orchestration, evaluation frameworks (evals), and reliability engineering.
  • Experience managing and building engineering teams of 5+ people (direct reports or equivalent), including hiring, coaching, and raising technical standards.
  • Experience at a growing startup or scale-up, comfortable operating in fast-moving, ambiguous environments and creating structure where needed.
  • Strong technical judgment and enough depth to evaluate agent architectures, system design, failure modes, and engineering quality with credibility.
  • Excellent written and verbal communication skills, with experience partnering across product, data science, and distributed teams.
  • Experience with reliability, observability, and production operations for complex AI or distributed systems.

Nice to have

  • Experience in fintech, fraud, credit risk, AML, compliance, or other regulated industries.
  • Prior experience with Model Context Protocol (MCP), multi-agent orchestration, or large-scale agent evaluation systems.

Details

  • Remote senior engineering leadership role based in the US.
  • Reports into engineering leadership with direct ownership of a critical part of Oscilar's agent platform.
  • Tech stack: LangGraph (or similar agent frameworks), AWS Bedrock, Python + Java, MCP.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)