evaluation

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Circle is seeking a Lead Engineer for AI Quality to build evaluation frameworks, observability tooling, and diagnostic infrastructure for its AI agents. This hands-on coach role also leads the AI Quality engineering team and collaborates with AI Core engineering to deliver reliable, scalable AI features. You will design datasets, run experiments across...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of...

Circle is seeking a Lead Engineer for AI Quality to build evaluation frameworks, observability tooling, and diagnostic infrastructure for its AI agents. This hands-on coach role also leads the AI Quality engineering team and collaborates with AI Core engineering to deliver reliable, scalable AI features. You will design datasets, run experiments across...

Workster is partnering with a leading global customer experience company to recruit English-speaking AI Data Evaluation Specialists for an innovative AI project based in Lisbon, Portugal.Join a team focused on reviewing, evaluating, and improving AI-generated responses to help create safer, more accurate conversational experiences for millions of users...

YO AI Labs is seeking a Creative & Design Specialist for a remote, contract role to support AI-driven visual projects across graphic design, video editing, and UI/UX workflows.You will assess AI-generated outputs, provide high-quality feedback, and annotate assets to improve training data, with hands-on use of tools like Figma, After Effects, DaVinci...

pStealth AI Startup seeks a Senior Evaluation Engineer to ensure that the system’s outputs are correct, private, grounded, and trustworthy before release. You will own comprehensive evaluation across multiple dimensions, including data provenance, evidence tracing, and privacy safeguards. /ppYou will drive benchmarking, create gold standards, and align...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including metrics and staging validations. The role is fully...

Descrição do cargo Senior Evaluation Engineer — Lisbon | Stealth AI Startup We're building a new kind of collective intelligence platform: AI that turns unstructured communication into grounded insights, recommendations, and actions. We're in stealth mode, but the challenge is anything but quiet. We're looking for a Senior Evaluation Engineer to make...

YO AI Labs is seeking a seasoned Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and technical problem-solving. This is a remote, contractor role requiring strong cross-stack proficiency. You will develop front-end and back-end features, work with APIs and databases, review...

YO AI Labs is seeking a seasoned Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and technical problem-solving. This is a remote, contractor role requiring strong cross-stack proficiency. You will develop front-end and back-end features, work with APIs and databases, review...

Mercor in Lisbon is seeking an Analyst / Insights professional with strong analytics, research, or insights experience. You will review, assess, and provide structured feedback on domain documents to ensure quality, accuracy, and relevance. Ideal candidates have a Bachelor’s degree and at least 2 years in a relevant field, with excellent Excel,...

Mercor in Lisbon is seeking an Analyst / Insights professional with strong analytics, research, or insights experience. You will review, assess, and provide structured feedback on domain documents to ensure quality, accuracy, and relevance. Ideal candidates have a Bachelor’s degree and at least 2 years in a relevant field, with excellent Excel,...

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving AI systems. This remote contractor role emphasizes evaluation and analysis rather than roadmap ownership or delivery management. You will assess AI-generated content, specifications, release notes, and documentation,...

A leading AI solutions company in Portugal is seeking statisticians for project-based roles focused on evaluating and improving AI systems. Candidates should have a degree in Statistics or a related field, at least 3 years of professional mathematics experience, and strong Python skills for validation. The position is part-time and non-permanent, with...