Remote Search Quality Evaluator

YO AI Labs is seeking an AI Evaluation Specialist (contractor) to assess enterprise AI outputs against detailed rubrics, measuring accuracy, relevance, quality, and guideline adherence. You will provide concise, actionable feedback to help improve AI systems and maintain thorough documentation of evaluations. Ideal candidates have experience in grading,...

Evaluate and rate search engine results, AI-generated answers, and recommendations to improve information retrieval systems. Requires objective judgment and clear English communication.

Mercor is seeking an Academic Evaluator who can work fully remotely from Portugal. The role focuses on reviewing and assessing domain-specific documents to ensure quality, accuracy, and relevance.You will provide structured feedback to improve evaluation standards, collaborate asynchronously with teams, and work independently to meet deadlines on high-impact...

Evaluate AI-generated responses for safety, accuracy, and policy compliance, focusing on sensitive domains and identifying unsafe outputs.

Mercor, a global talent network for AI research, is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, accuracy, and policy compliance. Responsibilities include reviewing content across sensitive domains, refining RLHF and SFT rubrics, and identifying unsafe outputs and reasoning failures. You...

Mercor is seeking an AI Safety Practitioner for a remote contract role. You will evaluate AI-generated responses for safety, accuracy, and policy compliance, review content across sensitive domains, refine RLHF and SFT rubrics, and identify unsafe outputs and reasoning failures.A Bachelor's degree or higher and 5+ years in AI safety are required, with...

Mercor is looking for Document Evaluators to review and assess domain-specific documents remotely. The role involves providing feedback to improve evaluation processes and requires a Bachelor’s degree and 2+ years of relevant experience.Candidates should possess strong analytical skills and proficiency in Excel, PowerPoint, and Word. This position is open...

Overview: Are you a web-savvy, search expert with a talent for finding things online by using just a few words? Do you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients' search engine responds to everyday searches from everyday people. Using your search...

Evaluate AI responses for safety, accuracy, and policy compliance, refining rubrics and identifying unsafe outputs for a remote contract role.