Senior Software Engineer, Coding

Overview

Senior Software Engineer to build systems that power high-quality coding data and evaluations for next-generation AI models, including software engineering benchmarks, code review evaluation, agentic coding workflows, and developer-facing tools.

What you'll do

• Design, build, and operate scalable software systems for coding evaluation, data generation, and agentic development workflows.
• Develop tools and services that analyze, validate, and improve AI-generated code.
• Build reliable pipelines for code execution, testing, benchmarking, and quality measurement.
• Partner with engineering, research, operations, and customer-facing teams to translate complex requirements into practical systems.
• Drive technical decisions across architecture, APIs, data models, observability, and operational excellence.
• Improve engineering velocity through reusable frameworks, automation, and developer tooling.
• Lead projects from ambiguous problem definition through design, implementation, launch, and iteration.
• Mentor engineers through design reviews, code reviews, and day-to-day collaboration.
• Establish high standards for maintainability, correctness, security, and reliability.

What you'll need

• 6+ years of professional software engineering experience.
• Strong proficiency in Python, JavaScript/TypeScript, Go, or another modern programming language.
• Experience designing and operating production systems with meaningful scale, reliability, and performance requirements.
• Strong understanding of software engineering fundamentals, including testing, APIs, data structures, distributed systems, and observability.
• Experience building developer tools, infrastructure, data pipelines, evaluation systems, or other technically complex products.
• Ability to work effectively in ambiguous environments and break large problems into clear, executable plans.
• Excellent written and verbal communication skills, with the ability to explain technical tradeoffs to both technical and non-technical partners.
• A track record of taking ownership and delivering high-quality results in collaboration with research and customer teams.

Nice to have

• Experience with AI/ML evaluation, coding agents, LLM applications, or developer productivity tools.
• Familiarity with code execution sandboxes, GitHub workflows, CI/CD systems, or benchmark infrastructure.
• Experience working with containerization, cloud platforms, databases, and distributed job orchestration.
• Contributions to open-source software or a demonstrated passion for improving developer tools.
• Experience partnering with research teams or customers to deliver technically rigorous solutions.