Remote Ai Safety Evaluator

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities...

Alignerr is seeking AI Ethics Reviewers to evaluate AI-generated content for bias, safety, and ethical concerns. This fully remote, flexible hourly contract role offers the chance to shape how AI behaves for diverse audiences. You'll review content, provide structured feedback, and apply fairness standards across a wide range of topics. No formal ethics or...

Odixcity Consulting seeks a detail-oriented LLM Evaluator to assess and improve large language model outputs, focusing on factuality, coherence, safety, and alignment with guidelines. You will judge model responses, provide clear feedback, and help refine evaluation rubrics. Responsibilities include ranking responses, comparing prompts, calibrating scores...

Mercor, a global talent network for AI research, is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, accuracy, and policy compliance. Responsibilities include reviewing content across sensitive domains, refining RLHF and SFT rubrics, and identifying unsafe outputs and reasoning failures. You...

Mercor is seeking a Music Production Expert - Portuguese for a remote contract role. You will evaluate AI-generated music across genres for musicality, label songs by genre, structure, and instruments, and review AI-generated lyrics and vocals against reference material. Work independently to meet deadlines, collaborate with AI research teams to enhance...

TSMG is seeking a dedicated remote professional for a multi-month project to test and evaluate an AI agent during its development stage. You will generate prompts, assess responses, and ensure safety by avoiding harmful outputs. Training is provided online before starting, with a fully remote, full-time arrangement for several months. Fluent Portuguese and...

Mercor seeks a bilingual Portuguese Generalist Expert focused on AI safety to write expert-level prompts in Portuguese and apply structured guidelines for classification and escalation. The role requires independent work, strong judgment on sensitive topics, and the ability to document reasoning clearly. The contractor will help evaluate how AI models handle...

Mercor seeks an AI Safety Practitioner for a remote contract position. You will evaluate AI-generated responses for safety, factual accuracy, and policy compliance, reviewing content across sensitive domains and applying evaluation rubrics for RLHF, SFT, and benchmarking. Strong English, critical thinking, and analytical skills are required. You will...

Mercor connects elite creative and technical talent with leading AI research labs and offers a remote contract position for AI Safety Experts fluent in English and Portuguese. The role focuses on red-teaming conversational AI, annotating failures, and documenting vulnerabilities to help clients improve model safety. Applicants should demonstrate strong...