AI Trainer | Remote

Responsibilities

• Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs.
• Analyze task performance and provide structured, actionable feedback to guide improvement and calibration.
• Establish and document effective scoring methodologies that ensure consistency, fairness, and high-quality outcomes.
• Lead calibration sessions to align evaluators and maintain rubric integrity across projects.
• Validate assessment outputs for accuracy, reliability, and alignment with project objectives.
• Oversee quality control processes, making data-driven recommendations for rubric enhancements.

• Have proven expertise in rubric design, performance analysis, and feedback structuring for complex assessment environments.
• Possess a strong background in scoring methodology development and calibration for AI or educational projects.
• Demonstrate success in assessment validation and quality control processes.
• Have exceptional written and verbal communication skills, with the ability to convey nuanced judgment and rationale.
• Have practical, hands‑on grocery shopping experience to inform realistic scenario assessments.