Freelance Agent Evaluation Engineer

Innodata Inc. seeks a Freelance Audio Engineer in Portugal to evaluate spoken interactions and assess English communication quality. You will participate in speech-to-speech evaluation tasks, judge pronunciation, fluency, clarity, and naturalness, and report findings according to project guidelines. Qualifications include excellent English listening and...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

EPAM Systems in Portugal seeks an Agent Evaluation Engineer to design and maintain a build-time evaluation framework for AI agents. You will implement automated tests, staging validations, and deployment gates integrated with production feedback to ensure robustness. You will develop multi-layer evaluation suites blending deterministic checks with...

EPAM Systems Inc in Portugal is seeking an Agent Evaluation Engineer to design and maintain an evaluation framework for AI agents, blending deterministic tests with LLM-powered graders. The role focuses on build-time frameworks, CI/CD gates, and deployment validations within a remote setup. You will collaborate with SRE and ML teams to implement staging...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

Position : Coding Agent Evaluation Specialist (LLM Eval & AI Training) Employment Type : Remote Freelance Working Hour : Flexible About the Opportunity We are building a talent pool of qualified professionals for upcoming and future Coding Agent Evaluation and AI Training projects. This freelance, fully remote opportunity is ideal for software engineers,...

Set Europa is seeking an experienced Python Developer to join a remote project building an AI-driven document analysis platform. You will develop scalable AI-powered solutions, integrate LLMs, and create robust document processing pipelines. The role requires 3–5 years of Python experience, hands-on work with LLMs and RAG, embeddings, vector databases,...

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Portugal. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably,...