evaluation

Prolific is seeking Fluent Bengali speakers to help train and evaluate AI models. If you have the necessary experience, a quick Hallo skills test will determine your suitability for our Domain Expert participant pool. Successful candidates can join Prolific and earn paid tasks up to $20/hr. Expect to analyze, edit, and write in Bengali, judge AI performance...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

Prolific is seeking Fluent Bengali speakers to help train and evaluate AI models. If you have the necessary experience, a quick Hallo skills test will determine your suitability for our Domain Expert participant pool. Successful candidates can join Prolific and earn paid tasks up to $20/hr. Expect to analyze, edit, and write in Bengali, judge AI performance...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

Mindrift Connects Specialists with Project‑Based AI Opportunities Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What this opportunity involves We're building a dataset to evaluate AI coding...

Backend engineer to design and maintain AI-driven platform services, working with Python, Docker, and AWS, focusing on healthcare solutions.

Backend engineer to design and maintain AI-driven platform services, working with Python, Docker, and AWS, focusing on healthcare solutions.

Backend engineer to design and maintain AI-driven platform services, working with Python, Docker, and AWS, focusing on healthcare solutions.

Backend engineer to design and maintain AI-driven platform services, working with Python, Docker, and AWS, focusing on healthcare solutions.

Backend engineer to design and maintain AI-driven platform services, working with Python, Docker, and AWS, focusing on healthcare solutions.

2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Python Developer in EMEA.In this role, you will be part of a dynamic startup environment, contributing to the design and development of innovative...

2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Python Developer in EMEA.In this role, you will be part of a dynamic startup environment, contributing to the design and development of innovative...

Part-time AI company in Lisbon is looking for remote contributors for AI agent quality assurance roles. Requires analytical thinking, attention to detail, and English communication skills.

Remote Design Specialist to evaluate AI-generated visuals, provide feedback, and annotate assets for AI training. Requires hands-on experience with design and video editing tools.

Part-time AI company in Lisbon is looking for remote contributors for AI agent quality assurance roles. Requires analytical thinking, attention to detail, and English communication skills.

2 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior Python Developer in EMEA.In this role, you will be part of a dynamic startup environment, contributing to the design and development of innovative...

Seeking an AI Agent Evaluation Analyst for a freelance, part-time role to validate and improve AI agent performance. Responsibilities include reviewing evaluation tasks, identifying inconsistencies, and ensuring AI agents are tested properly. Requires strong analytical thinking and attention to detail.