Staff + Senior Software Engineer, Inference Deployment

Overview

Staff + Senior Software Engineer for building and maintaining Claude inference deployment systems, covering the full stack from request routing to fleet-wide orchestration across AI accelerators.

What you'll do

• Design, build, and maintain distributed systems that serve Claude to millions of users.
• Develop resilient systems that adapt in real time to real-world events.
• Create intelligent request routing, load balancing, and traffic management across thousands of accelerators.
• Maximize fleet compute efficiency via autoscaling and orchestration for production, research, and experimental workloads.
• Build and operate production-grade deployment pipelines for releasing new models to users.
• Integrate new AI accelerator platforms and support inference for new model architectures.
• Provide high-performance inference infrastructure to enable next-generation model research.

What you'll need

• Significant software engineering experience, particularly with distributed systems.
• Results-oriented approach with a bias towards flexibility and impact.
• Willingness to pick up slack outside your job description.
• Desire to learn more about machine learning systems and infrastructure.
• Ability to thrive where technical excellence drives business results and research breakthroughs.
• Care about the societal impacts of the work.
• Proficiency in Python or Rust.

Details

• Annual salary range: $320,000–$485,000 USD.
• Minimum education: Bachelor’s degree or equivalent combination relevant to the role.
• Location-based hybrid policy: staff expected in one of the offices at least 25% of the time.