Empregos de remote agent evaluation engineer build-time framework em Remote

Associate Customer Success Manager | Sustainability | Fashion Supply Chains Location: Remote - Europe, United KingdomAbout WorldlyWorldly is the world’s most comprehensive impact intelligence platform — delivering real data to businesses on impacts within their supply chain. Worldly is trusted by 40,000 global brands, retailers, and manufacturers to...

About LastPassLastPass delivers Secure Access Essentials, helping individuals and organizations manage and protect access to AI, applications, and credentials straight from the browser. Trusted by more than 100,000 businesses and millions of users worldwide, LastPass blends strong security with everyday simplicity. From discovering unapproved AI and...

CapsLock builds exceptional marketing solutions for large partners in the home improvement industry. We don’t just advertise our clients’ products or services - we build long-term marketing solutions within the context of permanent partnerships.Our people are the backbone of everything we do and are our most valuable asset. Our business model demands...

We're looking for an Agent Evaluation Engineer — Build-Time Framework & Deployment Gates to join our team in Portugal in a fully remote working mode. In this role, you will design and maintain an evaluation framework for AI agents, ensuring quality and compliance through automated tests and CI/CD deployment gates. You will develop multi-layer evaluation...

Syndigo gets great products chosen. Every choice in commerce, whether by a shopper, a search engine, a marketplace, or an AI assistant, is made on product data, and our software makes that data complete and trusted and moves it across the industry's largest two-sided commerce network: 15,000+ brands and 3,500+ retailers. Companies like AutoZone,...

Jobgether is seeking an AI Evaluation Engineer to design evaluation, testing, and observability infrastructure for production-grade AI agents. You will create scalable evaluation pipelines, automate tests, and implement robust regression and adversarial scenarios, all in a fully remote, globally distributed setting. You will own the evaluation architecture,...

Principal Software Developer  Lifecycle provide billing solutions to a number of high-profile customers in the telecommunications industry. Due to continued growth and increasing sales success, we are looking for a Principal Software Developer to join the team.  If you are passionate about creating innovate customer solutions, have significant coding...

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Portugal. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably,...

We're looking for a Senior ML / Evaluation Engineer to join our team in Portugal in a fully remote working mode. In this role, you will own the design and implementation of advanced evaluation frameworks for an Enterprise Agent Development Platform—a production-grade, cloud-native ecosystem enabling scalable, secure AI agent deployment. You will create...

EPAM Systems in Portugal is seeking a Senior ML / Evaluation Engineer to own the design and implementation of advanced evaluation frameworks for a cloud-native AI agent platform. You will craft evaluation strategies, deploy CI/CD gates, and integrate LLM-as-judge and deterministic evaluators into automated pipelines. You will work with AWS AgentCore modules,...

Remote Crew is seeking a Senior AI Engineer to own the intelligence layer of a compliant cloud orchestration platform. You will architect autonomous AI agents that operate across AWS, Azure, and GCP, turning black-box AI into predictable, type-safe enterprise tools. You'll build scalable microservices in Python and Go, apply LangChain/LangGraph, and...

BOI is seeking an AI Engineer to design and build production-grade AI systems for enterprise clients. You will create multi-step agents, tool-using LLMs, and orchestrate data pipelines that integrate into business processes. You’ll own evaluation, observability, and reliability, collaborating with engineers, strategists, and designers, and engaging with...

This opportunity is ideal for experienced Structural Engineers who enjoy solving complex engineering problems and want to apply their expertise to cutting-edge AI technology. What You'll Do: Design realistic AI training tasks based on structural engineering concepts and real-world design challenges. Create clear engineering problem statements covering...

Building the Future of Open Finance Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system. Proof of work Before...

Stott and May Inc. is seeking a Data Engineer to design, build and optimise cloud-based data pipelines for a modern platform. The role focuses on real-time data ingestion, transformation and modelling with Snowflake as the data warehouse and Kafka for streaming. You will work with architects, data scientists and analysts on requirements and delivery. The...

At Smart Working, we believe your job should not only look right on paper but also feel right every day. This isn’t just another remote opportunity — it’s about finding where you truly belong, no matter where you are. From day one, you’re welcomed into a genuine community that values your growth and well-being. Our mission is simple: to break down...

Job description A FCamara está em busca de um Fullstack AI Engineer Esta oportunidade é em parceria com uma das maiores referências nacionais em ensino superior na área da saúde, com forte presença nos cursos de Medicina e Odontologia. A instituição está em constante evolução e aposta em inovação e transformação digital para oferecer uma...

EPAM Systems is seeking a Backend Engineer — A2A Integration in Portugal for a fully remote role. You will design and build the Agent Gateway components, enable agent discovery, and implement JSON-based identity/configuration publishing. You will work with Python/Go, REST, and event-driven patterns to scale distributed agent ecosystems. You will focus on...

Sysmatch is seeking an AI Engineer for a remote role with 1 day per month in the office at Venda do Pinheiro. You will build GenAI applications, agents, and workflow automation components, integrating with Azure AI services, APIs, and enterprise data platforms. You will collaborate with data engineers and scientists to connect models and data pipelines into...

TalentCo are delighted to be working with a fast-growing Agentic AI startup looking to hire several high-calibre Senior Backend Engineers into their growing engineering team in the Portugal, having recently closed a significant seed funding round. This hire can be based fully-remote anywhere in Portugal, for this Silicon Valley headquartered startup. You...