Sr. QA Engineer

2 semanas atrás

Remote Portugal Hercules Tempo inteiro

About the role

As a Sr. QA Engineer at HerculesAI, you'll lead the charge in embedding quality throughout our entire software development lifecycle. You'll own end-to-end product quality—from defining success criteria and automation strategies to managing releases and ensuring post-deployment stability. You'll work closely with Engineering, Product, AI, and DevOps teams to ensure every release meets our standards for reliability, performance, and user impact—making quality a shared responsibility across the organization.

What you'll do

  • Lead end-to-end product quality and integrate QA across the SDLC (shift-left, CI/CD quality gates, test evidence as part of "definition of done").
  • Own Release Management: plan releases, cut release candidates, manage freeze windows, lead go/no-go, coordinate phased rollouts (flags/canary), and execute rollback plans.
  • Design and maintain automation for UI, API, component, and E2E tests in partnership with all Engineering teams; establish non-functional baselines (performance, security, accessibility, resilience).
  • Design, own, and evolve performance and stress testing (load, capacity, scalability): define SLIs/SLOs, create repeatable perf/stress suites, profile bottlenecks, and gate releases via CI/CD and PRV.
  • Translate business initiatives into clear acceptance criteria and measurable Success Criteria Docs (KPIs, telemetry, rollout/rollback triggers).
  • Partner with Engineering, Product, AI, and DevOps to ensure observability, PRV (post-release verification), incident retrospectives, and continuous improvement of quality KPIs.

Qualifications

  • 6–10+ years in QA/Software Engineering, including ownership of release management and large-scale test automation.
  • Required: Proficiency in Python (test harnesses, AI/LLM eval tooling, CI utilities) and ReactJS (TypeScript preferred) for UI testability reviews and building test fixtures/mocks.
  • Hands-on with modern delivery stacks (microservices, containers/K8s, CI/CD) and test frameworks (Playwright/Cypress, PyTest/JUnit/TestNG, k6/JMeter for performance).
  • Demonstrated experience validating AI/LLM features (prompt testing, guardrails/red-teaming, offline/online eval alignment).
  • Strong systems thinking and risk-based testing; fluency in telemetry/observability (logs, metrics, traces) and security/a11y/performance gates, including capacity planning and perf profiling.
  • Excellent communication skills for turning ambiguous requirements into unambiguous, testable criteria and leading cross-functional quality reviews.

Success Metric Examples
(The Sr. QA Engineer will owns definition, targets, and reporting of these KPIs.)

  • Shift-Left & SDLC Health: % stories with testable criteria at grooming ↑; pre-merge test pass rate ↑; escaped defects from unit/component layers ↓; lead time for changes ↓.
  • Release Quality: change failure rate ↓; rollback/hotfix frequency ↓; PRV (post-release verification) pass rate ↑; incident MTTR ↓.
  • Automation & Coverage: automated regression coverage ↑; flaky test rate ↓; time to fix flaky tests ↓; security/a11y/perf gate pass rate ↑.
  • Performance & Resilience: p95/p99 latency ↓; throughput ↑; saturation/error budget burn ↓; successful load/stress/soak test pass rate ↑; resiliency checks (retry/backoff, timeouts) pass rate ↑.
  • Observability & Evidence: % launches with telemetry + dashboards + alert thresholds = 100%; quality evidence attached to releases ↑; data-driven retros with action closure rate ↑.

  • Sr. Software Engineer

    Há 21 horas

    Remote (Portugal) Hercules Tempo inteiro

    About the roleWe're hiring a Senior Software Engineer who thrives at the intersection of large-scale systems, intelligent automation, and meaningful business impact. You'll help design and deliver backend foundations that power agentic systems operating over massive volumes of enterprise data—text, tables, and beyond. You'll pair sharp architectural...

  • Senior Mobile QA Engineer

    Há 21 horas

    Remote from Portugal Lisbon Tech Guide Tempo inteiro

    Company InformationMetaMask is both a blockchain wallet and a gateway to the entire decentralized web. MetaMask tools help people create communities, play video games, access financial services, make payments, invest in assets, survive from economic turmoil, and more use cases than we can even predict. MetaMask exists across multiple platforms (browser...

  • QA Engineer

    Há 2 dias

    Portugal KCS iT Tempo inteiro

    We're looking for the special, unique and amazing YOU! @ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and value...

  • QA Engineer

    1 dia atrás

    Portugal KCS iT Tempo inteiro

    We’re looking for the special, unique and amazing YOU! @ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and...

  • Qa Engineer

    Há 6 horas

    Portugal KCS iT Tempo inteiro

    We’re looking for the special, unique and amazing YOU! @ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and...

  • QA Engineer

    Há 4 horas

    Portugal KCS iT Tempo inteiro

    We’re looking for the special, unique and amazing YOU! @ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and...

  • QA Automation Engineer

    Há 4 dias

    Portugal Block Labs Tempo inteiro

    About Block Labs Block Labs is a premier technology studio operating at the bleeding edge of Web3, Artificial Intelligence, and iGaming. We don't just ship features; we engineer high-scale, production-grade platforms that power the next generation of digital products. We are a collective of senior engineers, product strategists, and builders who refuse to...

  • QA Engineer

    1 dia atrás

    Portugal KCS iT Tempo inteiro

    We're looking for the special, unique and amazing YOU!@ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work.At KCS we stand for equality and value...

  • Sr. DevOps Engineer

    2 semanas atrás

    Remote (Portugal) Hercules Tempo inteiro

    About the roleWe are seeking a Senior DevOps Engineer to design, automate, and operate infrastructure across both cloud (Azure, AWS, GCP) and on-prem environments. The role focuses on Kubernetes operations, CI/CD automation, hybrid infrastructure management, and security, with opportunities to support AI-powered workloads. This is a hands-on engineering...

  • QA Automation Engineer

    Há 21 horas

    Portugal Block Labs Tempo inteiro

    About Block LabsBlock Labs is a premier technology studio operating at the bleeding edge of Web3, Artificial Intelligence, and iGaming. We don't just ship features; we engineer high-scale, production-grade platforms that power the next generation of digital products.We are a collective of senior engineers, product strategists, and builders who refuse to...