Safeguards Enforcement Analyst, Integrity & Authenticity

Overview

Safeguards Enforcement Analyst for Integrity & Authenticity, responsible for building and running enforcement workflows to detect and mitigate misuse of AI systems for coordinated inauthentic behavior, election manipulation, and targeting/surveillance.

What you'll do

• Design and architect automated enforcement systems and scalable review workflows while maintaining high accuracy.
• Partner with Engineering and Data Science teams to optimize detection models for policy violations and enforcement systems.
• Review flagged content to drive enforcement actions and improve policies.
• Enforce usage policies focused on influence operations, disinformation, coordinated inauthentic behavior, election interference, and targeting/tracking/surveillance.
• Provide detailed feedback to the Safeguards policy design team based on real enforcement scenarios.
• Stay current on AI policy enforcement best practices, emerging threat tactics, and election/privacy/surveillance regulatory developments.

What you'll need

• Experience in trust & safety, policy enforcement, threat intelligence, or a related field focused on influence operations/disinformation/coordinated inauthentic behavior/election integrity/privacy & surveillance harms.
• Experience standing up and scaling policy enforcement or content review workflows.
• Proficiency in SQL and/or other data analysis tools for insights from large datasets.
• Experience identifying emerging risks and communicating findings to stakeholders across Product, Policy, Engineering, and Legal.
• Experience with generative AI products, including writing effective prompts for content review and enforcement.
• Understanding of implementing product policies at scale, including in the content moderation space.

Details

• Work mode: hybrid, with staff expected to be in an office at least 25% of the time.
• Weekend/holiday: may require responding to escalations, particularly around major electoral events.
• Visa sponsorship: the company sponsors visas and makes reasonable efforts for offered candidates.