G

Engineering Manager - Software Security & AI Benchmark Delivery

Gramian
NewPosted today

LOCATION

Colombia · Remote

EXPERIENCE

10+ Years

TYPE

Contract

SKILLS REQUIRED

Software SecurityTechnical LeadershipVulnerability ManagementCross-functional Collaboration

Job description

Overview

Lead the development and delivery of security-focused training and evaluation tasks for frontier AI coding models, overseeing multiple engineering pods as the final quality gate for delivered tasks.

What you'll do

  • Own delivery, quality, and capacity across multiple engineering pods, coordinating Pod Leads and ensuring consistent execution.
  • Plan task batches, assign work to Pod Leads, and monitor daily throughput against phase-specific targets.
  • Ensure batches meet Google's expectations for task volume, technical difficulty, quality standards, and delivery timelines.
  • Lead weekly client reporting, communicate progress, provide delivery forecasts, and raise risks or dependencies proactively.
  • Identify and escalate tooling issues, rate limits, safety blocks, staffing constraints, and other delivery risks.
  • Work directly with Google to clarify requirements and align on task scope, timelines, task volume, and difficulty changes.
  • Conduct final reviews of security tasks before delivery, ensuring technical accuracy, reproducibility, and resistance to gaming or superficial solutions.
  • Train and calibrate Pod Leads on CWE classification, verifier robustness, task difficulty, technical quality, and acceptance criteria.
  • Conduct interviews and make hiring decisions based on approved role requirements and project capacity needs.
  • Identify high-performing Trainers and support their development and promotion into Pod Lead positions.
  • Use throughput, workload, and quality data to forecast headcount requirements across project phases.
  • Initiate hiring waves approximately three weeks ahead of projected capacity requirements.
  • Use dashboards, performance indicators, and operational metrics to guide delivery decisions and staffing plans.

What you'll need

  • 10+ years of overall professional software engineering experience, with a strong background in software security.
  • Proven experience leading technical teams against measurable delivery, quality, and schedule targets.
  • Strong understanding of CWE, CVE, and OWASP Top 10 across multiple programming languages and software ecosystems.
  • Demonstrated experience reproducing software vulnerabilities, reviewing security patches, and evaluating proof-of-vulnerability tests.
  • Experience designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environments.
  • Strong proficiency in at least one major programming language, such as Python, JavaScript / TypeScript, Java, C / C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift.
  • Experience with Git, Linux, Bash, Docker, and common software security tooling.
  • Ability to use dashboards, throughput metrics, quality data, and operational reports to make delivery and staffing decisions.
  • Experience managing or mentoring technical teams, including assigning work, reviewing output, providing feedback, and developing team leads.
  • Excellent written and verbal communication skills, including the ability to explain technical risks and project status to clients and internal stakeholders.
  • Strong organizational and prioritization skills, with the ability to manage multiple pods, competing priorities, and delivery phases simultaneously.

Details

  • Contractor assignment, 3 months, expected to start next week.
  • 40 hours per week.
  • Fully remote.
  • Minimum 4 hours of overlap with PST.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Engineering Manager - Software Security & AI Benchmark Delivery