Staff + Senior Software Engineer, Inference

Overview

Staff/Senior Software Engineer for the Inference team, responsible for building and maintaining distributed inference systems that serve Claude to millions of users.

What you'll do

• Design, build, and maintain distributed systems serving Claude at global scale.
• Develop resilient, flexible systems that adapt in real time to real-world events.
• Build intelligent request routing, load balancing, and traffic management across accelerators.
• Maximize fleet compute efficiency via autoscaling and orchestration across workloads.
• Build and operate production-grade deployment pipelines for releasing new models.
• Integrate new AI accelerator platforms and support new model architectures.

What you'll need

• Significant software engineering experience, especially with distributed systems.
• Results-oriented approach with flexibility and impact focus.
• Willingness to pick up additional responsibilities outside your job description.
• Desire to learn machine learning systems and infrastructure.
• Experience environments where technical excellence drives business and research outcomes.

Details

• Annual compensation range: $320,000–$485,000 USD.
• Hybrid policy: in an office at least 25% of the time.
• Visa sponsorship is available, but not for every role/candidate.