Empregos de llm evaluator em Lisboa

Job Title: LLM Evaluator (Model Response Analyst) Location: Remote (Worldwide) Job Summary: We are seeking a detail-oriented and analytical LLM Evaluator to assess, analyze, and improve the performance of large language models (LLMs). In this role, you will evaluate AI-generated content for accuracy, coherence, factual reliability, bias, safety, and...

Odixcity Consulting seeks a detail-oriented LLM Evaluator to assess and improve large language model outputs, focusing on factuality, coherence, safety, and alignment with guidelines. You will judge model responses, provide clear feedback, and help refine evaluation rubrics. Responsibilities include ranking responses, comparing prompts, calibrating scores...

Job Title:LLM Evaluator (Model Response Analyst) Location:Remote (Worldwide) Job Summary:We are seeking a detail-oriented and analytical LLM Evaluator to assess, analyze, and improve the performance of large language models (LLMs).In this role, you will evaluate AI-generated content for accuracy, coherence, factual reliability, bias, safety, and alignment...

CloserHire is recruiting an Arabic-speaking AI Data Evaluation Specialist for a Lisbon-based project on advanced AI systems. You will review and improve AI-generated responses, ensure language accuracy, safety, and policy compliance, on a 24/7 rotating schedule with two days off. Relocation support is included. Ideal candidates are native Arabic speakers...

French AI Content Evaluator | Lisbon Interested in Generative AI and Large Language Models? Join an international team evaluating AI-generated content, datasets and written responses for quality and accuracy. €930 gross × 14 payments €7.63 daily meal allowance Relocation support provided On-site, 24/7 rotating shifts Native-level written French and B2+...

EPAM Systems in Portugal is seeking a Senior ML / Evaluation Engineer to own the design and implementation of advanced evaluation frameworks for a cloud-native AI agent platform. You will craft evaluation strategies, deploy CI/CD gates, and integrate LLM-as-judge and deterministic evaluators into automated pipelines. You will work with AWS AgentCore...

We're looking for a Senior ML / Evaluation Engineer to join our team in Portugal in a fully remote working mode. In this role, you will own the design and implementation of advanced evaluation frameworks for an Enterprise Agent Development Platform—a production-grade, cloud-native ecosystem enabling scalable, secure AI agent deployment. You will create...

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform. You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release. You will collaborate with platform, orchestration, and DevOps teams to ensure scalable,...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform.You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release.You will collaborate with platform, orchestration, and DevOps teams to ensure scalable,...

We're looking for a Senior ML / Evaluation Engineer to join our team in Portugal in a fully remote working mode.In this role, you will own the design and implementation of advanced evaluation frameworks for an Enterprise Agent Development Platform—a production-grade, cloud-native ecosystem enabling scalable, secure AI agent deployment.You will create...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode.In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates.You will develop multi-layer evaluation...

About The JobMercor connects elite creative and technical talent with leading AI research labs.Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.PositionBilingual Portuguese Generalist Evaluator ExpertTypeContractCompensation$12–$30/hourLocationRemoteDuration2–4...

About the roleTonic builds AI products used by healthcare professionals in their daily practice.Tonic AI is a CE-marked Class IIa medical device, in live clinical use across multiple European markets.As the AI Quality & Validation Specialist you own how we evaluate our AI products, and your sign-off is a mandatory gate for every production deployment.Our...

See what you can do with ProphixProphix helps finance teams work with greater flexibility and confidence through Prophix One®\ U****our Financial Performance Platform. We bring planning, reporting, and automation together so people can focus on higher‐value work instead of repetitive tasks. As we introduce more AI‐enabled capabilities, you will be part...