Staff + Sr. Software Engineer, Cloud Inference

Overview

Build and operate backend services that scale Claude inference across multiple cloud providers, owning the end-to-end serving stack on each platform.

What you'll do

• Design, build, and own backend services and infrastructure for Claude across multiple CSPs.
• Partner cross-functionally and with CSPs to stand up and operate the serving stack on new cloud platforms.
• Build and evolve CI/CD automation for reliably shipping new model versions without regressions.
• Create interfaces and tooling abstractions to enable cost-effective inference management across providers.
• Contribute to capacity planning, autoscaling, and workload routing to match supply and demand.
• Analyze observability data to identify performance bottlenecks, cost anomalies, and regressions, and drive remediation.

What you'll need

• Have significant software engineering experience in high-performance, large-scale distributed systems serving millions of users.
• Have experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure).
• Have exposure to Kubernetes, Infrastructure as Code, or container orchestration.
• Be curious about LLM serving (prior inference or ML experience not required).
• Thrive in cross-functional collaboration with internal teams and external partners.
• Have experience working with external partners to align goals and deliver impact.
• Be highly autonomous and take end-to-end ownership.

Details

• Annual salary range is listed as $320,000–$485,000 USD.
• Hybrid work policy: expected to be in an office at least 25% of the time.
• Visa sponsorship is available (not guaranteed for every role/candidate).