Quality Assurance Analyst
Guarde esta oferta e mantenha a sua pesquisa organizada
Crie uma conta gratuita para guardar ofertas, criar alertas e voltar a este anúncio a partir do seu painel.
Ao continuar, aceita os nossos Termos & Política de Privacidade.
Position:
LLM – AI Quality Analyst (Personalization) – PortugueseType:
Short-Term Contract (2 months)Compensation:
$11 per hourLocation:
Remote (Global)Commitment:
Part-time availability required ** hrs/week)Role Responsibilities
Evaluate a personalization feature for GeminiDesign and execute multi-turn conversational prompts that require the AI to leverage personal contextAssess how effectively the model uses personal context from past conversations and activity to generate relevant responsesEvaluate responses based on intent and appropriate application of personalizationAnalyze responses for grounding issues, flawed inferences, or hallucinationsAssess integration quality to ensure personal data is incorporated naturally into responsesPerform side-by-side evaluations and stack-rank model outputs based on usefulness, clarity, and overall experienceWrite clear rationales for rankings referencing specific conversation turnsExtract and verify debug information to confirm correct use of summaries and data sourcesMaintain data hygiene by deleting evaluation conversations after completionRequirements
Experience in data annotation, AI quality evaluation, content moderation, or related rolesFluency in Portuguese (reading and writing)Willingness to use a primary personal Google account and enable personal data sources for assessmentStrong analytical thinking and attention to detailExperience with creative prompt engineering and personalization conceptsAbility to provide structured feedback and clear written explanationsAbility to work independently in a remote setup
#J-*-Ljbffr