LLM AI Quality Analysts

IMMEDIATE HIRING | LLM / AI QUALITY ANALYST

We are hiring for LLM – AI Quality Analysts (Personalization) – English for a 4-month remote contract opportunity. Rate: $15/hr USD

Start Date:

Immediately Availability: 30–40 hours/week PST Overlap: 4 hours required Engagement:
Contractor

Education:

Bachelor’s or Master’s degree in IT or any IT-related field

Approved States:
Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Virginia, Wisconsin, Wyoming

• Strong English reading and writing skills
• Strong analytical and attention-to-detail skills
• AI evaluation, data annotation, content moderation, or related experience preferred
• Ability to work independently in a remote environment
• Laptop/Desktop with reliable internet
• Willingness to use a primary personal Google account and enable personal data sources for the assessment

• Evaluate personalized AI/Gemini responses
• Create and test multi-turn prompts
• Assess AI responses for Grounding, Integration, and Helpfulness
• Compare model responses side-by-side
• Identify incorrect personalization, poor inferences, and hallucinations
• Provide detailed feedback and rationales

This is a remote position.