AI QA Specialist

Há 8 horas


Lisboa, Lisboa, Portugal InnoTech Tempo inteiro

A Company you will be happy to grow with
;

At InnoTech, it´s all about connecting people with business through technology;

We care about you, your
happiness
, and your
well-being
;

We seek people who want to learn and further improve their skills with us –
growth
is part of our DNA, and that's why we're proud to be certified as a
Great Place to Work
and to be
among the Top 50 Best Workplaces in Portugal
;

For us,
sustainability
is not just a word;

Integrity
and
social responsibility
lead our behavior;

We dare to be
different
, ambitious, dream big, and deliver value like no other;

You will have the opportunity to work with
top-level partners
in the banking area, insurance, retail, telecommunications, financial services, and so much more;

We are 180+ InnoTechers, and we want your talent as an
AI QA Specialist.
Your Mission Will Be

  • Define, evolve, and maintain evaluation strategies for AI, LLM, and conversational systems;
  • Design and manage versioned datasets covering core flows, edge cases, negative scenarios, and safety validations;
  • Validate conversational behavior including intent recognition, slot extraction, state transitions, and business rules;
  • Detect regressions and evaluation drift across model, data, or prompt changes using reliable quality signals;
  • Collaborate with QA and ML teams to embed AI evaluation into CI/CD pipelines and release processes.

You Will Need

  • 4+ years of experience in QA, data, ML, or AI-adjacent roles with exposure to production systems;
  • Hands-on experience testing AI, LLM, NLU, or conversational systems and handling non-deterministic behavior;
  • Strong analytical skills with the ability to design deterministic validations where possible;
  • Experience working with structured outputs such as JSON schemas, tool usage, or function calling;
  • CPLP nationality or an EU work permit is required to facilitate employment.

Would Be Awesome If You Have

  • BSc or MSc in Computer Science/Engineering, Information Technology, or related fields;
  • Experience testing voice-based, conversational, or multimodal AI systems;
  • Background in data quality, analytics workflows, or ML pipelines;
  • Familiarity with observability, monitoring, or evaluation tooling for AI systems;
  • Scripting experience, preferably using Python.

With Us You Can Be a

  • TechThinker – people who want to re-imagine technology with us;
  • TechSolver – strategic, resilient, and a little bit of a puzzle lover;
  • InnoMinder – inhale innovation, exhale digital transformation;
  • InnoTecher – no words needed. Just happiness, talent, and all the above.

Are you convinced? Come see it for yourself.
Join our Top-Notch Team



  • Lisboa, Lisboa, Portugal Wire IT Tempo inteiro

    Based in Portugal, Wire IT is your specialized IT consulting partner with 18 years of experience driven by an experienced and senior team that helps clients make the right decisions in a fast-moving market.Wire IT's ambition is to grow while keeping true to its nature: agile, people-centered, and fun. As we like to say: "It's not only what we do, it's how we...

  • QA Engineer – Azure AI

    2 minutos atrás


    Lisboa, Lisboa, Portugal Wire It Tempo inteiro

    Based in Portugal, Wire IT is your specialized IT consulting partner with 18 years of experience driven by an experienced and senior team that helps clients make the right decisions in a fast-moving market.Wire IT's ambition is to grow while keeping true to its nature: agile, people-centered, and fun. As we like to say: "It's not only what we do, it's how we...


  • Lisboa, Lisboa, Portugal Inetum Tempo inteiro

    Company DescriptionInetum is a European leader in digital services. Inetum's team of 28,000 consultants and specialists strive every day to make a digital impact for businesses, public sector entities and society. Inetum's solutions aim at contributing to its clients' performance and innovation as well as the common good.Present in 19 countries with a dense...

  • Senior QA Gen AI

    Há 8 horas


    Lisboa, Lisboa, Portugal We Are META Tempo inteiro

    We're Hiring: Senior QA Gen AI — Rhino, are you out there?At WE ARE META, we connect Rhinos to projects where they can truly shine. If you are looking for growth, balance, and a team that truly supports you, this is the place for you. After all, we are experts at transforming raw talent into unstoppable force.Why you'll love being part of the team:Cool...

  • QA Tech Lead

    48 segundos atrás


    Lisboa, Lisboa, Portugal Axians Tempo inteiro

    The world is more connected than ever before and the pace of change is bewildering. We deliver the best combination of technology and services to enable our clients to fulfil the diverse needs of their customers. By fostering a deeply and personal relationship with our clients, we want to improve the lives of people and organizations.Axians is the VINCI...

  • AI Specialist

    38 segundos atrás


    Lisboa, Lisboa, Portugal Roland Berger Tempo inteiro

    Job Description As an AI Specialist, you will join our newly launched Roland Berger AI Lab, where we design innovative and scalable GenAI solutions to create tangible impact for our clients and ourselves. Our mission is to rapidly and securely scale our expertise across clients and within RB. In this role, you will design and implement advanced AI solutions...

  • Senior QA Gen AI

    Há 2 dias


    Lisboa, Lisboa, Portugal Damia Group Tempo inteiro

     Seeking a Senior QA Gen AI: Rhino, are you there?At WE ARE META, we focus on finding the perfect match between our Rhinos and our clients.Why join us?Expand your network: As a consultant at We Are META, you'll have access to a network of national and international partners across diverse sectors of the tech industry.Enjoy our perks: When you join the...


  • Lisboa, Lisboa, Portugal Zendesk Tempo inteiro

    Job DescriptionAI Specialist, Customer SuccessThe AI Specialist, Customer Success role is a dynamic customer advisory role responsible for getting customers to business outcomes as fast as possible using our cutting-edge Zendesk AI solutions.The overarching objective of the AI Specialist, Customer Success, is to ensure Zendesk customers realize business...


  • Lisboa, Lisboa, Portugal Neotalent Conclusion Tempo inteiro

    Who are we:Neotalent Conclusion is one of the leading Iberian specialists providing services in Information Technology and Engineering services. As part of the Netherlands-based organization Conclusion, which has an ecosystem of over 25 companies and 3,600 employees, we are focused on increasing the technological capacity of our clients and the digital...

  • AI Digital Assistant Specialist

    59 segundos atrás


    Lisboa, Lisboa, Portugal Smart Consulting Tempo inteiro

    Procuras o próximo passo na tua carreira enquantoAI Digital Assistant Specialist?Então chegaste ao sítio certo.A tecnologia, a inovação e a transformação estão no nosso ADN. Somos uma empresa focada no desenvolvimento de soluções tecnológicas inovadoras e procuramos pessoas curiosas, com vontade de aprender e de crescer connosco.Estamos à procura...