evaluation

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

Circle is seeking a Lead Engineer for AI Quality to build evaluation frameworks, observability tooling, and diagnostic infrastructure for its AI agents. This hands-on coach role also leads the AI Quality engineering team and collaborates with AI Core engineering to deliver reliable, scalable AI features. You will design datasets, run experiments across...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

Circle is seeking a Lead Engineer for AI Quality to build evaluation frameworks, observability tooling, and diagnostic infrastructure for its AI agents. This hands-on coach role also leads the AI Quality engineering team and collaborates with AI Core engineering to deliver reliable, scalable AI features. You will design datasets, run experiments across...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Circle is seeking a Lead Engineer for AI Quality to build evaluation frameworks, observability tooling, and diagnostic infrastructure for its AI agents. This hands-on coach role also leads the AI Quality engineering team and collaborates with AI Core engineering to deliver reliable, scalable AI features. You will design datasets, run experiments across...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...