Trust & Safety Evaluator with English from South Africa

Trust & Safety Evaluator conducts adversarial testing and safety evaluation of generative AI features. Main tasks are crafting queries, evaluating the safety of generated content and providing critical feedback. This role requires creative thinking about potential misuse, deep cultural and linguistic knowledge, and the ability to identify subtle safety risks.

Responsibilities

• Write, review and evaluate diverse and challenging queries designed to test the system's limits and expose problematic outputs. Queries target specific risk topics including explicit and/or offensive content
• Design and execute sequences of queries simulating realistic, unfolding conversations
• Craft attack scenarios using techniques like crescendo attacks and context manipulation to test the system
• Age-appropriate safety evaluation: guide adversarial query crafting and safety evaluation
• Assign risk ratings to AI-generated content based on safety ...