Overview
Lead the development and delivery of security-focused training and evaluation tasks for frontier AI coding models, overseeing multiple engineering pods as the final quality gate for delivered tasks.
What you'll do
- Own delivery, quality, and capacity across multiple engineering pods, coordinating Pod Leads and ensuring consistent execution.
- Plan task batches, assign work to Pod Leads, and monitor daily throughput against phase-specific targets.
- Ensure batches meet Google's expectations for task volume, technical difficulty, quality standards, and delivery timelines.
- Lead weekly client reporting, communicate progress, provide delivery forecasts, and raise risks or dependencies proactively.
- Identify and escalate tooling issues, rate limits, safety blocks, staffing constraints, and other delivery risks.
- Work directly with Google to clarify requirements and align on task scope, timelines, task volume, and difficulty changes.
- Conduct final reviews of security tasks before delivery, ensuring technical accuracy, reproducibility, and resistance to gaming or superficial solutions.
- Train and calibrate Pod Leads on CWE classification, verifier robustness, task difficulty, technical quality, and acceptance criteria.
- Conduct interviews and make hiring decisions based on approved role requirements and project capacity needs.
- Identify high-performing Trainers and support their development and promotion into Pod Lead positions.
- Use throughput, workload, and quality data to forecast headcount requirements across project phases.
- Initiate hiring waves approximately three weeks ahead of projected capacity requirements.
- Use dashboards, performance indicators, and operational metrics to guide delivery decisions and staffing plans.
What you'll need
- 10+ years of overall professional software engineering experience, with a strong background in software security.
- Proven experience leading technical teams against measurable delivery, quality, and schedule targets.
- Strong understanding of CWE, CVE, and OWASP Top 10 across multiple programming languages and software ecosystems.
- Demonstrated experience reproducing software vulnerabilities, reviewing security patches, and evaluating proof-of-vulnerability tests.
- Experience designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environments.
- Strong proficiency in at least one major programming language, such as Python, JavaScript / TypeScript, Java, C / C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
- Experience with Git, Linux, Bash, Docker, and common software security tooling.
- Ability to use dashboards, throughput metrics, quality data, and operational reports to make delivery and staffing decisions.
- Experience managing or mentoring technical teams, including assigning work, reviewing output, providing feedback, and developing team leads.
- Excellent written and verbal communication skills, including the ability to explain technical risks and project status to clients and internal stakeholders.
- Strong organizational and prioritization skills, with the ability to manage multiple pods, competing priorities, and delivery phases simultaneously.
Details
- Contractor assignment, 3 months, expected to start next week.
- 40 hours per week.
- Fully remote.
- Minimum 4 hours of overlap with PST.
Read the full description and apply on the company’s own careers page.