Portuguese-Speaking AI Data Evaluation Specialist – Lisbon, Portugal

Portuguese-speaking AI Data Evaluation Specialist | Large Language Models — Lisbon, Portugal. 920€ x 14 + 100€ Complexity Bonus paid in.

At a glance

Location: Lisbon, Portugal

Languages: Portuguese

Salary: 920€ x 14 + 100€ Complexity Bonus paid in

Start: 31/8

Relocation: not offered for this role

About the role CloserHire is partnering with a leading global customer experience company to recruit Portuguese-speaking AI Data Evaluation Specialists for an innovative artificial intelligence project based in Lisbon, Portugal. If you’re passionate about AI, language technology, and data quality, this is a unique opportunity to contribute to the development of next-generation Large Language Models (LLMs). You’ll work with cutting-edge AI systems by reviewing, evaluating, and improving AI-generated responses, helping create safer, more

What you'll do

Review and evaluate AI-generated responses using detailed annotation and quality guidelines

Label and annotate language model outputs with accuracy and consistency

Assess AI-generated content for quality, relevance, factual accuracy, safety, and policy compliance

Apply complex annotation guidelines across a wide variety of scenarios and content types

Identify inconsistencies, edge cases, and potential model issues, escalating when appropriate

Analyze structured text, datasets, and AI-generated content to support model improvement

Deliver high-quality work while consistently meeting productivity, quality, and accuracy targets

Maintain strict confidentiality and comply with all project standards, security requirements, and internal procedures

Contribute directly to the ongoing training and improvement of advanced AI systems through detailed evaluations and feedback 24/7 rotating schedule (Monday to Sunday) with 2 rotational days off

What we're looking for

Native-level fluency in Portuguese

Good command of English (B2 level or above)

Strong understanding of Generative AI, Large Language

Models (LLMs), and AI evaluation methodologies

Previous experience in AI data annotation, LLM evaluation, Reinforcement Learning from Human

Feedback (RLHF), Supervised

Fine-Tuning (SFT), Quality Assurance, Content

Labeling, Trust & Safety, or similar analytical roles is highly desirable

Excellent analytical thinking and attention to detail

Ability to interpret and consistently apply complex written guidelines and policies

Salary 920€ x 14 + 100€ Complexity Bonus paid in

Portuguese contracts pay 14 salaries a year — your normal monthly salary plus a holiday and a Christmas salary. The annual figure is therefore well above monthly × 12, which is worth doing the maths on before you compare it to an offer at home.

Benefits

Office-based position in Lisbon, Portugal

Comprehensive onboarding and specialized training in AI evaluation processes

Opportunity to work on one of the world’s most advanced artificial intelligence projects

International and multicultural working environment

Career development opportunities within the rapidly growing AI industry

Private health insurance Meal allowance

Ongoing learning and professional development

Modern office facilities with a collaborative team culture

Unique opportunity to shape the future of generative AI and language technologies

Why Portugal? Portugal is the most popular relocation destination we place into, and it earns that. Over 300 days of sun a year, some of the lowest living costs in Western Europe, and a large international community in Lisbon and Porto that makes arriving alone much less daunting. EU citizens need no visa — you can start immediately.

From application to starting on the ground usually takes around five weeks.

CloserHire recruits for this role on behalf of our client. We are an equal-opportunity recruiter and consider every applicant on ability alone.