Content Developer: Machine Learning Annotation

Remote

Correlation One develops workforce skills for the AI economy

Enterprises and governments work with us to develop talent and close critical data, digital, and technology skills gaps. Our global programs, including training programs and data competitions, also empower underrepresented communities and accelerate careers.

Our mission is to create equal access to the data-driven jobs of the future. We partner with top employers and government organizations to make that a reality, including Amazon, Coca-Cola, Johnson & Johnson, the U.S. State Department, and the U.S. Department of Defense.

Our skills training programs are 100% free for learners and are delivered virtually by industry experts to minimize traditional barriers to career advancement. We take pride in fostering supportive, human-led, group learning environments that build technical proficiency and confidence in participants.

Join us and let's shape the AI Economy together!

This is a part-time contract position. The contract is expected to run ~2–4 months, with an anticipated workload of ~10–15 hours per week (may vary based on program needs and consultant capacity).

The Machine Learning Annotation Content Developer will create high-quality instructional materials that teach modern data annotation and labeling workflows used to train and evaluate machine learning systems. The role will develop content across modalities—including text, image, video, audio/speech, and cross-modality labeling—translating real-world annotation tasks into clear, engaging, job-relevant learning experiences.

You will collaborate with our internal program team to produce session plans, hands‑on practice, examples, and assessments aligned to defined learning outcomes. Content should model best-in-class annotation behavior: rule-based decisions, clear rationales, consistent application of guidelines, and appropriate handling of ambiguity (e.g., escalation rather than guessing).

• Develop instructional lessons and training materials on:
  • Text annotation (e.g., classification, NER, span annotation, summarization evaluation, safety/toxicity, dialogue evaluation)
  • Audio and speech annotation (e.g., transcription conventions, speaker diarization concepts, intent/slot labeling, quality review)
  • Cross-modality labeling (e.g., image-text matching, VQA-style labeling, grounding references across modalities)
• Produce complete “content packages” per session/module (as applicable), such as:
  • Facilitator guide, learner materials, demos or walkthroughs, practice activities, “strong vs. weak” examples, rubrics/evaluation criteria, and short knowledge checks/assessments
• Create hands‑on exercises using a common annotation platform (e.g., Label Studio or similar), including:
  • Task setup guidance, labeling instructions, example labels, edge cases, and review workflows
• Review and iterate on content based on internal feedback and peer review
• Participate in weekly and ad‑hoc meetings with the program team to align on objectives, standards, and delivery constraints

• Demonstrated experience creating machine learning training content, instructional content, curriculum materials, or technical content for adult learners.
• Hands‑on experience as a data annotator, including using tools such as Label Studio or similar annotation platforms.
• Ability to translate complex content into clear, learner-friendly lessons with concrete examples.
• Strong command of English (written and verbal) with excellent attention to detail and consistency.
• Organized, deadline‑reliable, and comfortable working in a remote, fast-moving environment.

• Experience creating content across multiple data modalities (text, image, video, audio) and/or cross-modality tasks.
• Experience building rubrics, scoring guides, or evaluation criteria for annotation quality.

This role is remote and can be located anywhere that is compatible with EST time zone. We are headquartered in New York City and have office space in Midtown Manhattan.

Correlation One is proud to be an Equal Opportunity Employer and is committed to providing equal opportunity…