Senior Ml Evaluation Engineer

Há 3 semanas

Aveiro, Portugal Epam Systems, Inc. Tempo integral

EPAM Systems, Inc. is seeking a Senior ML / Evaluation Engineer to design and implement advanced evaluation frameworks for an Enterprise Agent Development Platform.
You will build LLM-as-judge evaluators and deterministic validators to enforce quality before release.You will collaborate with platform, orchestration, and DevOps teams to ensure scalable, observable evaluation in production, leveraging AWS services, OpenTelemetry, and CloudWatch for monitoring and scoring.