Remote AI Evaluation Engineer

Mercor is seeking a DevOps/SRE/Cloud Engineer with Coding Agent Experience for a remote contract role. You will use frontier AI coding agents to tackle complex infrastructure tasks, review model-generated implementations across cloud platforms, Kubernetes, CI/CD, and observability tooling, and identify issues in model outputs.The role requires evaluating...

Lifted (an Upwork Company) is seeking experienced Structural Engineers to design AI training tasks rooted in structural engineering principles. You will craft problem statements, reference solutions, and deterministic scoring criteria while building tasks in OpenSees and related methods. The role focuses on evaluating AI-generated solutions with technical...

Circle Internet Financial is hiring a Lead Engineer for the AI Quality engineering team. You will build evaluation frameworks, observability tooling, and diagnostic infrastructure to ensure AI agents perform reliably and cost-efficiently. This is a hands-on, player-coach role with leadership responsibilities. You’ll lead the team, set technical direction,...

AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify issues,...

AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify...

YO AI Labs is seeking a highly skilled Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and problem-solving.The role is fully remote, contractor-based, approx. 15 hours per week, with a flexible schedule. You will work across frontend and backend, build features, APIs, and data...

An AI Data Services company is looking for a remote Kotlin Engineer to develop AI training content and evaluate AI responses for quality. The role requires at least 2 years of Kotlin development experience and strong English writing skills. Responsibilities include creating prompts for AI learning, optimizing AI model performance, and ensuring model...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

YO AI Labs is seeking a highly skilled Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and problem-solving. The role is fully remote, contractor-based, approx. 15 hours per week, with a flexible schedule. You will work across frontend and backend, build features, APIs, and data...