Safeguards Enforcement Analyst, Cyber Harm

Overview

Safeguards Enforcement Analyst, Cyber Harm reviews flagged content and accounts and takes enforcement actions to mitigate misuse of Anthropic’s AI systems for malicious cyber operations.

What you'll do

• Review flagged content and accounts to make accurate, well-documented enforcement decisions aligned to usage policies.
• Detect and mitigate potential AI misuse facilitating cyberattacks, malware creation, exploitation tooling, and related harmful operations.
• Triaging and escalate novel, ambiguous, or high-severity cases to appropriate stakeholders.
• Provide detailed feedback to the Safeguards policy design team on policy gaps found through enforcement scenarios.
• Partner with Engineering and Data Science by surfacing detection model errors and quality signals from reviews.
• Maintain high accuracy and consistency standards across review queues.
• Stay current on AI policy enforcement best practices, threat actor tactics, and the evolving cyber threat landscape.

What you'll need

• Experience in cybersecurity, including knowledge of offensive techniques, exploit development, malware analysis, or vulnerability research.
• Experience performing content review, abuse investigations, or policy enforcement at volume.
• Proficiency in SQL and/or Python for data analysis and threat detection.
• Experience identifying emerging risks and communicating findings to Product, Policy, Engineering, and Legal stakeholders.
• Experience working with generative AI products, including writing effective prompts for content review and enforcement.

Details

• Annual compensation range listed as $285,000–$330,000 USD.
• Hybrid work: staff expected in one of the company offices at least 25% of the time.
• Respond to escalations during weekends and holidays may be required.
• Visa sponsorship is available for some roles/candidates.