Empregos de evaluation em Braga

Mercor in Lisbon is seeking Engineering / Platform professionals to review, assess, and provide structured feedback on domain-specific documents, ensuring quality, accuracy, and relevance. You will follow documented guidelines, collaborate with reviewers, and contribute to high-impact evaluation projects that influence product quality and compliance. This...

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Portuguese and English. Key responsibilities include comparing AI-generated lyrics with published songs, rating lyrics on quality,...

YO AI Labs is seeking experienced Technical Writers / Editors for a contractor role to evaluate and improve AI-generated content. You will apply strong editorial judgment, assess clarity and tone, and provide actionable feedback to enhance model outputs. No prior AI experience required, but excellent English and analytical skills are essential. Work...

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving AI systems. This remote contractor role emphasizes evaluation and analysis rather than roadmap ownership or delivery management. You will assess AI-generated content, specifications, release notes, and documentation,...

Mindrift is launching a remote, project-based consultant role focused on translating real-world engagements into structured learning environments for advanced AI systems. You will design end-to-end consulting tasks, scenarios, and evaluation criteria grounded in top-tier industry practice. We seek consultants with 3+ years’ direct experience at McKinsey,...

1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets...

A leading AI solutions company in Portugal is seeking statisticians for project-based roles focused on evaluating and improving AI systems. Candidates should have a degree in Statistics or a related field, at least 3 years of professional mathematics experience, and strong Python skills for validation. The position is part-time and non-permanent, with...

YO AI Labs is seeking a Creative & Design Specialist to support a customer project covering graphic design, multimedia production, UI/UX, motion graphics, and creative workflows. Remote, worldwide with a flexible schedule. You will evaluate AI-generated outputs and provide high-quality human feedback for AI training. Prior paid experience in human-data work...

We're looking for a Senior ML / Evaluation Engineer to join our team in Portugal in a fully remote working mode. In this role, you will own the design and implementation of advanced evaluation frameworks for an Enterprise Agent Development Platform—a production-grade, cloud-native ecosystem enabling scalable, secure AI agent deployment. You will create...

EPAM Systems, Inc. is seeking an Agent Evaluation Engineer to build evaluation frameworks for AI agents, combining deterministic and LLM-based grading with CI/CD deployment gates. You will design multi-layer evaluation suites, simulate multi-turn conversations, and establish reliability metrics, including pass@k metrics and staging validations. The role is...

Prolific is seeking Fluent Bengali speakers to help train and evaluate AI models. If you have the necessary experience, a quick Hallo skills test will determine your suitability for our Domain Expert participant pool. Successful candidates can join Prolific and earn paid tasks up to $20/hr. Expect to analyze, edit, and write in Bengali, judge AI performance...

Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands‑on security experience to work involving vulnerabilities, exploit verification and security patches. This is a contracting engagement, with potential for a longer-term engagement. Remote candidates in the...

Braintrust is seeking a seasoned software engineer to help a top AI lab evaluate and improve large language models through security-focused coding tasks. You will evaluate vulnerabilities, reproduce exploits, verify patches, and create prompts and reference answers; assess model outputs for code generation, debugging and refactoring. Remote contracting with...

Circle is seeking a Lead Engineer for AI Quality to build evaluation frameworks, observability tooling, and diagnostic infrastructure for its AI agents. This hands-on coach role also leads the AI Quality engineering team and collaborates with AI Core engineering to deliver reliable, scalable AI features. You will design datasets, run experiments across...

Mercor in Lisbon is seeking an Analyst / Insights professional with strong analytics, research, or insights experience. You will review, assess, and provide structured feedback on domain documents to ensure quality, accuracy, and relevance. Ideal candidates have a Bachelor’s degree and at least 2 years in a relevant field, with excellent Excel,...

Mercor is seeking senior HR professionals to craft evaluation tasks for AI-driven talent management, employee relations, and organizational design. The role spans US and International compliance tracks, inviting experts in either or both tracks to apply. Contributors design HR scenarios, draft outputs, and write rubrics that capture how senior HR leaders...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of...

YO AI Labs is seeking a seasoned Full-Stack Software Engineer to support an AI training project focused on software development, debugging, code evaluation, and technical problem-solving. This is a remote, contractor role requiring strong cross-stack proficiency. You will develop front-end and back-end features, work with APIs and databases, review...

YO AI Labs is seeking a Creative & Design Specialist for a remote, contract role to support AI-driven visual projects across graphic design, video editing, and UI/UX workflows. You will assess AI-generated outputs, provide high-quality feedback, and annotate assets to improve training data, with hands-on use of tools like Figma, After Effects, DaVinci...

Mercor is seeking Generalist professionals with broad domains to review and assess domain-specific documents. You will provide structured feedback to ensure quality, accuracy, and relevance across evaluation projects. This role suits candidates with strong analytical skills and clear, well-written communication. Applicants should hold a bachelor’s degree...