evaluation

Job Title: Data ScientistJob Type: ContractorLocation: RemoteRole Overview Partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing...

pStealth AI Startup seeks a Senior Evaluation Engineer to ensure that the system’s outputs are correct, private, grounded, and trustworthy before release. You will own comprehensive evaluation across multiple dimensions, including data provenance, evidence tracing, and privacy safeguards. /ppYou will drive benchmarking, create gold standards, and align...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including metrics and staging validations. The role is fully...

Descrição do cargo Senior Evaluation Engineer — Lisbon | Stealth AI Startup We're building a new kind of collective intelligence platform: AI that turns unstructured communication into grounded insights, recommendations, and actions. We're in stealth mode, but the challenge is anything but quiet. We're looking for a Senior Evaluation Engineer to make...

YO AI Labs is seeking a seasoned Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and technical problem-solving. This is a remote, contractor role requiring strong cross-stack proficiency. You will develop front-end and back-end features, work with APIs and databases, review...

YO AI Labs is seeking a seasoned Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and technical problem-solving. This is a remote, contractor role requiring strong cross-stack proficiency. You will develop front-end and back-end features, work with APIs and databases, review...

Mercor in Lisbon is seeking an Analyst / Insights professional with strong analytics, research, or insights experience. You will review, assess, and provide structured feedback on domain documents to ensure quality, accuracy, and relevance. Ideal candidates have a Bachelor’s degree and at least 2 years in a relevant field, with excellent Excel,...

Mercor in Lisbon is seeking an Analyst / Insights professional with strong analytics, research, or insights experience. You will review, assess, and provide structured feedback on domain documents to ensure quality, accuracy, and relevance. Ideal candidates have a Bachelor’s degree and at least 2 years in a relevant field, with excellent Excel,...

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving AI systems. This remote contractor role emphasizes evaluation and analysis rather than roadmap ownership or delivery management. You will assess AI-generated content, specifications, release notes, and documentation,...

YO AI Labs is seeking a Creative & Design Specialist to support a customer project covering graphic design, multimedia production, UI/UX, motion graphics, and creative workflows. Remote, worldwide with a flexible schedule. You will evaluate AI-generated outputs and provide high-quality human feedback for AI training. Prior paid experience in human-data work...

YO AI Labs is seeking experienced Technical Writers / Editors for a contractor role to evaluate and improve AI-generated content. You will apply strong editorial judgment, assess clarity and tone, and provide actionable feedback to enhance model outputs. No prior AI experience required, but excellent English and analytical skills are essential. Work...

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving AI systems. This remote contractor role emphasizes evaluation and analysis rather than roadmap ownership or delivery management. You will assess AI-generated content, specifications, release notes, and documentation,...

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving AI systems. This remote contractor role emphasizes evaluation and analysis rather than roadmap ownership or delivery management. You will assess AI-generated content, specifications, release notes, and documentation,...

Obsidian is hiring an Analyst / Insights professional with experience in analytics, research, or insights roles. You will review, assess, and provide structured feedback on domain-specific documents to ensure quality, accuracy and relevance.This position suits professionals with strong analytical skills and domain expertise who can contribute to high-impact...

YO AI Labs is seeking a seasoned Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and technical problem-solving. This is a remote, contractor role requiring strong cross-stack proficiency. You will develop front-end and back-end features, work with APIs and databases, review...

An innovative AI company in Lisbon seeks part-time contributors for Quality Assurance roles focused on AI agents. Ideal applicants will have strong analytical thinking, attention to detail, and the ability to communicate findings in English. This freelance opportunity allows you to work flexibly on exciting AI projects while contributing to the future of...

YO AI Labs is seeking a Creative & Design Specialist for a remote, contract role to support AI-driven visual projects across graphic design, video editing, and UI/UX workflows. You will assess AI-generated outputs, provide high-quality feedback, and annotate assets to improve training data, with hands-on use of tools like Figma, After Effects, DaVinci...

Prolific is seeking Fluent Bengali speakers to help train and evaluate AI models. If you have the necessary experience, a quick Hallo skills test will determine your suitability for our Domain Expert participant pool. Successful candidates can join Prolific and earn paid tasks up to $20/hr. Expect to analyze, edit, and write in Bengali, judge AI performance...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

YO AI Labs is seeking a Creative & Design Specialist for a remote, contract role to support AI-driven visual projects across graphic design, video editing, and UI/UX workflows. You will assess AI-generated outputs, provide high-quality feedback, and annotate assets to improve training data, with hands-on use of tools like Figma, After Effects, DaVinci...