AI Policy Reviewer – Remote

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance checkpoint, safeguarding model integrity by identifying safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify and report systematic flaws, bias patterns, hallucinations, or policy gaps to product and engineering teams.
• Collaborate with policy teams to refine evaluation rubrics and test their teachability to AI models.
• Participate in adversarial testing (red‑team) to uncover vulnerabilities before product launch.
• Provide clear feedback to machine‑learning engineers, explaining rating decisions and helping adjust model behavior.
• Create high‑quality prompt‑response examples for “golden sets” used in model training.

Required profile

• Minimum 3 years of experience in Trust & Safety, Content Policy, Risk Analysis, or Legal/Compliance review.
• Strong emotional resilience and self‑care strategies for exposure to disturbing content.
• Excellent written communication able to explain technical issues to engineers and policy experts.
• Understanding of global cultural and political nuances for diverse audiences.

Required skills

• Familiarity with large language models (e.g., ChatGPT, Gemini).
• Proficiency with dashboard and spreadsheet tools for data analysis.
• Experience using specialized content‑review platforms.