Empregos de llm evaluator em Porto

Job Title: LLM Evaluator (Model Response Analyst) Location: Remote (Worldwide) Job Summary: We are seeking a detail-oriented and analytical LLM Evaluator to assess, analyze, and improve the performance of large language models (LLMs). In this role, you will evaluate AI-generated content for accuracy, coherence, factual reliability, bias, safety, and...

Odixcity Consulting seeks a detail-oriented LLM Evaluator to assess and improve large language model outputs, focusing on factuality, coherence, safety, and alignment with guidelines. You will judge model responses, provide clear feedback, and help refine evaluation rubrics. Responsibilities include ranking responses, comparing prompts, calibrating scores...

Internet Safety Evaluator – Portuguese (Portugal)Location: Porto, P13, PTJob OverviewThis Full time on site position offers great opportunities for career growth.A Day in the Life of an Internet Safety EvaluatorIn this role, you will be evaluating and providing feedback on online video search results in order to improve their content and quality. A very...

EPAM Systems in Portugal is seeking a Senior ML / Evaluation Engineer to own the design and implementation of advanced evaluation frameworks for a cloud-native AI agent platform. You will craft evaluation strategies, deploy CI/CD gates, and integrate LLM-as-judge and deterministic evaluators into automated pipelines. You will work with AWS AgentCore...

We're looking for a Senior ML / Evaluation Engineer to join our team in Portugal in a fully remote working mode. In this role, you will own the design and implementation of advanced evaluation frameworks for an Enterprise Agent Development Platform—a production-grade, cloud-native ecosystem enabling scalable, secure AI agent deployment. You will create...

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform. You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release. You will collaborate with platform, orchestration, and DevOps teams to ensure scalable,...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

About the role Tonic builds AI products used by healthcare professionals in their daily practice. Tonic AI is a CE-marked Class IIa medical device, in live clinical use across multiple European markets. As the AI Quality & Validation Specialist you own how we evaluate our AI products, and your sign-off is a mandatory gate for every production deployment....

About the role Tonic builds AI products used by healthcare professionals in their daily practice. Tonic AI is a CE-marked Class IIa medical device, in live clinical use across multiple European markets. As the AI Quality & Validation Specialist you own how we evaluate our AI products, and your sign-off is a mandatory gate for every production deployment....

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode.In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates.You will develop multi-layer evaluation...

About the role Tonic builds AI products used by healthcare professionals in their daily practice.Tonic AI is a CE-marked Class IIa medical device, in live clinical use across multiple European markets.As the AI Quality & Validation Specialist you own how we evaluate our AI products, and your sign-off is a mandatory gate for every production deployment.Our...

We're looking for a Senior ML / Evaluation Engineer to join our team in Portugal in a fully remote working mode.In this role, you will own the design and implementation of advanced evaluation frameworks for an Enterprise Agent Development Platform—a production-grade, cloud-native ecosystem enabling scalable, secure AI agent deployment.You will create...

About the roleTonic builds AI products used by healthcare professionals in their daily practice. Tonic AI is a CE-marked Class IIa medical device, in live clinical use across multiple European markets. As the AI Quality & Validation Specialist you own how we evaluate our AI products, and your sign-off is a mandatory gate for every production deployment. Our...

About the role Tonic builds AI products used by healthcare professionals in their daily practice. Tonic AI is a CE-marked Class IIa medical device, in live clinical use across multiple European markets. As the AI Quality & Validation Specialist you own how we evaluate our AI products, and your validation sign-off is required before any production deployment....