Staff Software Engineer, Node Infra

Overview

Staff Software Engineer for Node Infra, owning the end-to-end lifecycle of accelerator capacity and the cluster systems that keep AI compute fleets healthy and ready.

What you'll do

• Own the technical strategy and roadmap for node lifecycle management, including ingestion, bring-up, health checking, and automated repair.
• Drive cross-team initiatives to build and scale AI clusters across multiple clouds and accelerator families.
• Design and operate detection and remediation systems for unhealthy hardware to increase fleet MTBI and reduce stranded capacity.
• Define infrastructure architecture and ensure complex problems are solved directly or through others.
• Partner with cloud providers and internal research/inference/product teams to shape long-term compute, data, and infrastructure strategy.
• Establish and evolve operational excellence practices such as incident response, postmortems, and on-call.
• Provide technical mentorship and coaching to support engineers on the team.

What you'll need

• Deep expertise in distributed systems, reliability, and cloud platforms (e.g., Kubernetes, IaC, AWS/GCP/Azure).
• Strong proficiency in at least one systems language (e.g., Rust, Go, or Python).
• IaC proficiency with Terraform.
• Hands-on experience with machine learning accelerators (GPUs, TPUs, or Trainium).
• Track record leading complex, multi-quarter technical initiatives across multiple teams or systems.
• Ability to build alignment across senior stakeholders and communicate effectively at all levels.

Details

• Location: hybrid policy expects staff to be in an office at least 25% of the time.
• Visa sponsorship: offered, with stated eligibility limitations.