Evaluation Specialist

AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify issues,...

Mercor in Lisbon is seeking Engineering / Platform professionals to review, assess, and provide structured feedback on domain-specific documents, ensuring quality, accuracy, and relevance. You will follow documented guidelines, collaborate with reviewers, and contribute to high-impact evaluation projects that influence product quality and compliance. This...

Mercor is seeking an Executive Assistant / Admin for a remote, contract role. You will review and assess domain-specific documents for quality, provide structured feedback, and collaborate asynchronously with teams to meet deadlines. The ideal candidate has a bachelor’s degree, 2+ years of relevant experience, and strong MS Office skills (Excel,...

Alignerr Corp. is seeking a Nursing Informatics Specialist (AI Training) for a remote, hourly-contract role. Your clinical expertise will help evaluate AI outputs, ensure nursing workflows are accurately reflected, and guide improvements in healthcare AI systems. The position emphasizes independent work, flexible scheduling, and collaboration with AI...

Mercor seeks an AI Safety Practitioner for a remote contract position. You will evaluate AI-generated responses for safety, factual accuracy, and policy compliance, reviewing content across sensitive domains and applying evaluation rubrics for RLHF, SFT, and benchmarking. Strong English, critical thinking, and analytical skills are required. You will...

Mercor is seeking a Generalist on a contract basis to review and assess domain-specific documents for quality and accuracy, providing structured feedback to improve relevance and impact. The role requires 2+ years of experience, a Bachelor's degree, and strong skills in Excel, PowerPoint, and Word. You will work asynchronously and collaboratively to meet...

SME Careers in a fully remote contractor role seeks experts to review AI-generated responses, generate language content, and evaluate reasoning quality and problem solving. You will provide expert feedback so outputs are accurate, logical, and clearly explained.This position requires native Portuguese proficiency with Portugal conventions, plus C1 English,...

Invisible Technologies Inc. is seeking independent Audio Evaluation Specialists to support an AI benchmark evaluation project focused on agentic audio models. Contractors will design evaluation frameworks, run role-play scenarios across travel, finance, and telecom contexts, audit model outputs, and generate clean datasets to improve model performance....

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities -...