Empregos para ai evaluation engineer em Lisboa

Venture Up in Lisbon is seeking a Senior Evaluation Engineer to ensure our platform is correct, private, grounded, and trustworthy before it reaches users.You will define and execute evaluation across NLP, entity resolution, adversarial testing, grounded generation, and end-to-end data handling. Join a stealth AI startup shaping benchmarks and release...

A project-based AI solutions provider in Portugal seeks experienced developers to create and refine challenging coding tests for AI systems. The ideal candidates will have a degree in Computer Science or related fields, strong expertise in Python, and significant experience with Full-Stack development. This part-time opportunity involves working on tasks...

Alignerr in Lisbon is seeking Software Engineers to build, evaluate, and improve AI-generated code for training AI systems to think like real developers. You will write solutions, review AI outputs, and provide expert feedback. This remote, hourly contract role offers flexible hours and the chance to work asynchronously on frontier AI projects with...

Senior Evaluation Engineer — Lisbon | Stealth AI Startup We’re building a new kind of collective intelligence platform: AI that turns unstructured communication into grounded insights, recommendations, and actions. We’re in stealth mode, but the challenge is anything but quiet. We’re looking for a Senior Evaluation Engineer to make sure what we build...

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Portuguese and English. Key responsibilities include comparing AI-generated lyrics with published songs, rating lyrics on quality,...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback. Responsibilities - Evaluate...

Mindrift Connects Specialists with Project‐Based AI Opportunities Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What this opportunity involves We're building a dataset to evaluate AI coding...

1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets...

Mercor is seeking senior HR professionals to craft evaluation tasks for AI-driven talent management, employee relations, and organizational design. The role spans US and International compliance tracks, inviting experts in either or both tracks to apply. Contributors design HR scenarios, draft outputs, and write rubrics that capture how senior HR leaders...

Mindrift is launching a remote, project-based consultant role focused on translating real-world engagements into structured learning environments for advanced AI systems. You will design end-to-end consulting tasks, scenarios, and evaluation criteria grounded in top-tier industry practice. We seek consultants with 3+ years’ direct experience at McKinsey,...

An AI Data Services company is looking for a remote Kotlin Engineer to develop AI training content and evaluate AI responses for quality. The role requires at least 2 years of Kotlin development experience and strong English writing skills. Responsibilities include creating prompts for AI learning, optimizing AI model performance, and ensuring model...

Mercor is seeking Engineering / Platform professionals with strong analytical skills to review, assess, and provide structured feedback on domain-specific documents. You will contribute to high-impact evaluation projects from Lisbon, Portugal. Ideal candidates have a bachelor’s degree, 2+ years in a relevant field, and proficiency with Excel, PowerPoint...

The lemon Consulting in Lisbon, Portugal is seeking a Customer Support Representative to review and annotate AI-generated responses, ensuring quality, accuracy and policy compliance in a fast-paced environment. You will work on-site in central Lisbon, use AI annotation platforms, and collaborate with multilingual teams. Requirements include native Polish,...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback. Responsibilities Evaluate...

Overview Are you passionate about linguistics, language quality, and evaluation? We are launching an exciting language evaluation project and are looking for German-speaking linguistics experts to join our team as Quality Control Specialists. In this role, you will assess and refine AI‑generated language outputs, focusing on linguistic accuracy, grammar,...

Workster is partnering with a leading global customer experience company to recruit English-speaking AI Data Evaluation Specialists for an innovative AI project based in Lisbon, Portugal. Join a team focused on reviewing, evaluating, and improving AI-generated responses to help create safer, more accurate conversational experiences for millions of users...

An innovative AI company in Lisbon seeks part-time contributors for Quality Assurance roles focused on AI agents. Ideal applicants will have strong analytical thinking, attention to detail, and the ability to communicate findings in English. This freelance opportunity allows you to work flexibly on exciting AI projects while contributing to the future of...

Cbtalents is hiring for an Italian-Speaking Customer Service Specialist for the ByteDance LLM Project in Portugal. Native Italian speakers with strong analytical skills will support customer service and AI evaluation tasks in an international setting. The role offers on-site work with relocation support, a salary of €1,000 per month paid across 14 months,...

AI Labeling & Evaluation Agent (French-Speaking) As a Labeling & Evaluation Agent in Lisbon, Portugal (On-site), you will contribute to the development and improvement of cutting‑edge artificial intelligence systems by evaluating AI‑generated responses, applying detailed guidelines, and ensuring high‑quality annotations that help improve the accuracy,...

Job Title AI Labeling & Evaluation Agent (Italian‑Speaking) Job Description Experience the power of a game-changing career! Are you looking for what's next? We're a global technology and services leader that powers the brands of the future. We help well-known brands—the ones you use every day—improve their businesses with technology and integrated...