Pre-training Distributed Systems Tech Lead / Manager

Overview

Tech lead/manager for Anthropic’s Evals Infrastructure team, building distributed systems and harnesses that run and scale evaluations for frontier model training.

What you'll do

• Lead distributed systems that schedule, orchestrate, and execute evals.
• Own eval throughput and cost via compute allocation, queueing, caching, and reuse.
• Build and scale harnesses researchers use to define, run, and iterate on evals.
• Improve reliability of eval results with determinism, reproducibility, and uncertainty quantification.
• Ensure eval signal reaches dashboards and review workflows for launch decisions.
• Contribute as an engineer while managing and growing the team, prioritizing work and coaching.

What you'll need

• Led technical projects end-to-end on large-scale distributed systems.
• 1+ years managing engineers (or tech-lead-with-reports experience).
• Strong skills in Python and Rust.
• Experience building high-throughput, fault-tolerant systems on cloud or on-prem accelerator fleets.
• Strong measurement quality mindset, including noticing metric issues.
• Ability to communicate with researchers and translate research needs into infrastructure.

Details

• Location-based hybrid policy: in one of the offices at least 25% of the time.