AI Rater Guidelines Writer; Linguist/Instructional Designer
Listed on 2026-09-12
-
IT/Tech
AI Evaluation
Overview
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.
Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking talented Linguists and Instructional Designers with deep experience translating ambiguous program requirements into clear, unambiguous rater guidelines to bring precision and consistency to our AI training data
working across domains from finance and retail to insurance, legal, and sports.
This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.
Key Responsibilities- Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across a range of subject-matter domains.
- Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.
- Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.
- Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.
- Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.
- 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.
- Demonstrated ability to work across multiple subject-matter domains (e.g., finance, retail, insurance, legal, sports) and translate domain-specific nuance into clear, unambiguous instructions.
- Strong track record of resolving ambiguity and contradiction in written specifications able to point to concrete before/after examples.
- Demonstrable career progression.
- Ability to engage reliably for at least 35 hours/week during weekdays.
- Strong written communication skills and the ability to explain complex or nuanced guidance clearly and precisely.
About Cincinnatus LLC:
Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.
Equal Employment Opportunity:
Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.
AI evaluation Clinical reasoning Finance Research Technical writing
Who this role may fitThis opportunity may suit professionals with relevant experience in AI evaluation, Clinical reasoning, Finance, Research. Review the official description and requirements before applying.
CompensationThe listing states $45 - $65 / hour. Confirm the final rate, workload, and payment terms during the official application process.
- You can show recent, specific work involving AI evaluation, Clinical reasoning, Finance.
- The listed commitment of 35 hours/week fits your schedule.
- You can communicate your reasoning clearly in the application language.
- You are comfortable with project availability and hours varying over time.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).