evaluation

Prolific is seeking Fluent Bengali speakers to help train and evaluate AI models. If you have the necessary experience, a quick Hallo skills test will determine your suitability for our Domain Expert participant pool. Successful candidates can join Prolific and earn paid tasks up to $20/hr. Expect to analyze, edit, and write in Bengali, judge AI performance...

YO AI Labs is seeking a Creative & Design Specialist for a remote, contract role to support AI-driven visual projects across graphic design, video editing, and UI/UX workflows. You will assess AI-generated outputs, provide high-quality feedback, and annotate assets to improve training data, with hands-on use of tools like Figma, After Effects, DaVinci...

YO AI Labs is seeking a seasoned Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and technical problem-solving. This is a remote, contractor role requiring strong cross-stack proficiency. You will develop front-end and back-end features, work with APIs and databases, review...

YO AI Labs is seeking a Creative & Design Specialist for a remote, contract role to support AI-driven visual projects across graphic design, video editing, and UI/UX workflows. You will assess AI-generated outputs, provide high-quality feedback, and annotate assets to improve training data, with hands-on use of tools like Figma, After Effects, DaVinci...

Prolific is seeking Fluent Bengali speakers to help train and evaluate AI models. If you have the necessary experience, a quick Hallo skills test will determine your suitability for our Domain Expert participant pool. Successful candidates can join Prolific and earn paid tasks up to $20/hr. Expect to analyze, edit, and write in Bengali, judge AI performance...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

Prolific is seeking Fluent Bengali speakers to help train and evaluate AI models. If you have the necessary experience, a quick Hallo skills test will determine your suitability for our Domain Expert participant pool. Successful candidates can join Prolific and earn paid tasks up to $20/hr. Expect to analyze, edit, and write in Bengali, judge AI performance...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform. You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release. You will collaborate with platform, orchestration, and DevOps teams to ensure scalable,...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform. You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release. You will collaborate with platform, orchestration, and DevOps teams to ensure scalable,...

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform. You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release. You will collaborate with platform, orchestration, and Dev Ops teams to ensure scalable,...

CloudLinux is a global remote-first company. We are driven by our principles: do the right thing, employees first, we are remote first, and we deliver high-volume, low-cost Linux infrastructure and security products that help companies to increase the efficiency of their operations. Every person on our team supports each other and does what we can to ensure...

CloudLinux is a global remote-first company. We are driven by our principles: do the right thing, employees first, we are remote first, and we deliver high-volume, low-cost Linux infrastructure and security products that help companies to increase the efficiency of their operations. Every person on our team supports each other and does what we can to ensure...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring.Remote contracting with...

SIEM & Threat Detection Engineer | Security OperationsBuild, tune and continuously improve enterprise threat detection capabilities.Portugal - Candidates must already have the legal right to work in Portugal.International Cybersecurity ProgrammeWe're looking for an experienced SIEM & Threat Detection Engineer to join a major international cybersecurity...