Staff + Sr. Software Engineer, Cloud Inference Launch Engineering

Overview

Lead cloud inference validation and launch engineering for Claude on AWS, GCP, and Azure, ensuring correctness, performance, and reliability.

What you'll do

• Bring new inference and frontier model architectures to cloud platforms in lockstep with first-party launches.
• Integrate and deploy inference features (e.g., structured sampling, prompt caching) to production on each cloud platform.
• Identify cross-platform inference gaps (e.g., config drift, observability gaps, deployment pattern differences) and fix them at the source.
• Design, build, and operate CI/CD infrastructure for the inference server and load balancer across cloud platforms.
• Drive faster, more parallel, and cost-effective validation to reduce merge-to-production cycle time.
• Analyze observability data to find bottlenecks, cost anomalies, and regressions and drive remediation.

What you'll need

• Significant software engineering experience in high-performance, large-scale distributed systems serving millions of users.
• Track record of building automation or test infrastructure that improved release velocity or reliability.
• Experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure).
• Exposure to Kubernetes, Infrastructure as Code, or container orchestration.
• Strong interest in LLM serving.
• Capability to collaborate across teams and external partners.
• Autonomy to own problems end-to-end.

Details

• Hybrid policy: staff expected to be in one of the offices at least 25% of the time.
• Visa sponsorship: offered, with reasonable efforts if an offer is made.