AI Content Reviewer (Remote)

About the role

We are looking for a meticulous AI Content Reviewer to evaluate and improve AI‑generated outputs across text, image descriptions, and code. The role is fully remote and focuses on ensuring accuracy, factual integrity, brand alignment, and compliance with safety and ethical standards.

Key responsibilities

• Review AI‑generated content for accuracy, relevance, toxicity, and bias.
• Create high‑quality training datasets by labeling data according to strict guidelines.
• Audit work of junior reviewers or automated systems to maintain consistency.
• Collaborate with operations teams to refine style guides and annotation instructions.
• Identify model error patterns and provide detailed feedback to data scientists and engineers.
• Monitor basic metrics such as inter‑agreement rates and F1 scores to gauge impact on model performance.

Required profile

• Minimum 2 years of professional experience in content review, moderation, fact‑checking, or quality assurance.
• Proven ability to analyze complex information quickly and justify decisions under ambiguous guidelines.
• Comfort handling potentially sensitive or disturbing content with professionalism.
• Experience with generative AI models (e.g., ChatGPT, Bard, Midjourney) from a testing or feedback perspective.
• Background in linguistics, data annotation, or computational linguistics.
• Ability to thrive in a fast‑paced, evolving environment.

Required skills

• Experience with generative AI model testing and feedback loops.
• Proficiency in data annotation platforms and tools.
• Strong command of spreadsheet software for data handling.
• Familiarity with basic statistical metrics (F1 score, inter‑agreement rates).