Empregos de evaluation em Porto

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Evaluation Consultant based in Portugal. This opportunity offers experienced evaluation professionals the chance to contribute to international development and digital transformation initiatives through independent,...

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Portugal. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably,...

Mercor connects elite creative and technical talent with leading AI research labs. The company offers a fully remote contract position for an Evaluation Specialist focused on document review, quality assessment, and structured feedback. The role emphasizes independent, asynchronous work and collaboration with cross-functional teams to improve document...

We're looking for a Senior ML / Evaluation Engineer to join our team in Portugal in a fully remote working mode. In this role, you will own the design and implementation of advanced evaluation frameworks for an Enterprise Agent Development Platform—a production-grade, cloud-native ecosystem enabling scalable, secure AI agent deployment. You will create...

Position : Coding Agent Evaluation Specialist (LLM Eval & AI Training) Employment Type : Remote Freelance Working Hour : Flexible About the Opportunity We are building a talent pool of qualified professionals for upcoming and future Coding Agent Evaluation and AI Training projects. This freelance, fully remote opportunity is ideal for software engineers,...

YO AI Labs is seeking experienced Product Managers and Product Owners for a remote contractor role focused on evaluating and improving AI systems. You will assess AI-generated content, specifications, and product documentation, with no requirement for prior AI experience. This evaluation and analysis role does not involve roadmap ownership or program...

Circle Internet Financial is hiring a Lead Engineer for the AI Quality engineering team. You will build evaluation frameworks, observability tooling, and diagnostic infrastructure to ensure AI agents perform reliably and cost-efficiently. This is a hands-on, player-coach role with leadership responsibilities. You’ll lead the team, set technical direction,...

Superhuman is hiring a foundational Machine Learning Engineer to join our Porto team and build the evaluation foundation behind the next generation of AI-native productivity on our agent platform. You will own how we define, measure, and improve quality, building eval datasets, the infrastructure around them, and the metrics that tell us whether our models...

Jobgether is seeking an AI Evaluation Engineer to design evaluation, testing, and observability infrastructure for production-grade AI agents. You will create scalable evaluation pipelines, automate tests, and implement robust regression and adversarial scenarios, all in a fully remote, globally distributed setting. You will own the evaluation architecture,...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Call For Referral is seeking experienced Investment Banking professionals to contribute to advanced AI research and evaluation projects. The role centers on applying investment banking expertise to assess financial analyses, company appraisals, and strategic insights to improve AI outputs. You'll review AI-generated financial analyses, assess research...

Innodata Inc. seeks a Freelance Audio Engineer in Portugal to evaluate spoken interactions and assess English communication quality. You will participate in speech-to-speech evaluation tasks, judge pronunciation, fluency, clarity, and naturalness, and report findings according to project guidelines. Qualifications include excellent English listening and...

1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets...

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform. You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release. You will collaborate with platform, orchestration, and DevOps teams to ensure scalable,...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

TÜV SÜD Gruppe sucht eine/n Medizinexperte/in mit abgeschlossenem Medizinstudium und fundierter klinischer Praxis in Chirurgie oder Urologie. Die Position umfasst MDR-Bewertungen, Berichte bei Nichtkonformitäten und interne Beratung in klinischen Fragen. Sie arbeiten in einem internationalen Team, nutzen MS Office-Tools und kommunizieren...

An AI Data Services company is looking for a remote Kotlin Engineer to develop AI training content and evaluate AI responses for quality. The role requires at least 2 years of Kotlin development experience and strong English writing skills. Responsibilities include creating prompts for AI learning, optimizing AI model performance, and ensuring model...

An innovative AI company in Lisbon seeks part-time contributors for Quality Assurance roles focused on AI agents. Ideal applicants will have strong analytical thinking, attention to detail, and the ability to communicate findings in English. This freelance opportunity allows you to work flexibly on exciting AI projects while contributing to the future of...

TÜV SÜD Gruppe sucht eine/n Medizinexperte/in mit abgeschlossenem Medizinstudium und fundierter klinischer Praxis in Chirurgie oder Urologie. Die Position umfasst MDR-Bewertungen, Berichte bei Nichtkonformitäten und interne Beratung in klinischen Fragen. Sie arbeiten in einem internationalen Team, nutzen MS Office-Tools und kommunizieren...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...