Position: LLM AI Quality Analyst (Personalization) – Norwegian
Type: Hourly Contract
Compensation: $11 – $15 per hour
Location: Remote
Commitment: 30–40 hours per week
Job Overview
We are seeking a detail-oriented LLM AI Quality Analyst with strong Norwegian language skills to evaluate and improve AI-generated responses, particularly in the area of personalization. This role is ideal for individuals who enjoy analyzing language, identifying subtle inaccuracies, and shaping how AI systems interact with users in a meaningful and context-aware way.
Key Responsibilities
- Assess AI-generated responses for personalization quality, focusing on accuracy, relevance, and usefulness
- Create and execute multi-turn prompts based on personal context to test AI behavior and capabilities
- Identify issues such as hallucinations, incorrect personalization, and flawed reasoning
- Conduct side-by-side comparisons of model outputs to determine quality and effectiveness
- Write clear, structured justifications for evaluations and ranking decisions
- Review and validate debug data to ensure proper use of sources and context
- Maintain high standards of data accuracy and documentation throughout evaluations
- Collaborate with cross-functional teams to enhance overall AI model performance
Requirements
- Strong proficiency in Norwegian, with excellent reading and writing skills
- Experience in data annotation, AI evaluation, content moderation, or related fields
- Strong analytical mindset with the ability to assess nuanced and complex responses
- Ability to design creative, multi-step prompts grounded in personal context
- Solid understanding of personalization concepts, including identifying forced or inaccurate personalization
- Exceptional attention to detail when comparing outputs and evaluating quality
- Clear and structured written communication skills
- Ability to work independently in a remote setting
- Willingness to use a personal Google account for evaluation tasks
- Availability for full-time work, with at least 4 hours overlap with PST
- Bachelor’s degree or equivalent experience in a relevant analytical field
Application Process
- Submit your application via the “Apply” or “Easy Apply” option
- Check your email for further instructions and application form
- Complete the required Google form
- Undergo language proficiency vetting
- Complete the assessment task within 24 hours after shortlisting
How to Apply?
If you are interested in this Job
CLICK HERE TO APPLY NOW