Senior Engineering Manager, AI

Overview

Senior Engineering Manager for the AI Platform team at AlphaSense, leading the AI Gateway that routes high-throughput LLM traffic across the ecosystem.

What you'll do

• Manage, mentor, and grow a team of up to 10 senior and staff software engineers.
• Own AI Gateway strategy and architecture, ensuring high availability and low-latency routing, caching, queueing, and fallback mechanisms.
• Lead multi-vendor orchestration across 6+ LLM vendors and 50+ models to optimize latency, cost, and reliability.
• Align the gateway roadmap with product features and organizational goals in partnership with product management, AI research, and engineering leads.
• Define and champion engineering best practices, architectural standards, and token-based cost-tracking telemetry.

What you'll need

• Proven engineering leadership managing and growing high-performing teams of senior and staff engineers.
• Experience designing, building, and operating high-throughput, low-latency distributed systems for routing, caching, queueing, or rate limiting.
• Ability to lead architectural discussions and provide constructive technical direction during architectural reviews.
• Exceptional communication and partnership skills to align stakeholders across R&D.
• Hands-on familiarity with multi-vendor integrations.

Details

• Work mode: Remote (United States).