Film And Television AI Evaluation Expert
-
Entertainment & Gaming
-
IT/Tech
Job Description & How to Apply Below
About Open Train
Open Train is the #1 platform for finding and building careers in AI training and data labeling. Open Train AI is hiring and contracting for this role, helping contributors apply their expertise to projects that shape how modern AI systems work.
- Apply through Open Train for a specialized AI evaluation opportunity.
- Build experience in a fast-growing field where human expertise improves AI quality.
AI training is the human side of building artificial intelligence. Specialists create examples, review model responses, identify errors, and provide carefully reasoned feedback so large language models become more accurate, useful, and reliable.
- Work remotely with a computer and internet connection.
- Use your subject-matter knowledge to evaluate AI-generated content.
- Contribute to cutting-edge generative AI development.
Open Train is seeking a Film and Television AI Evaluation Expert to create challenging, domain-specific prompts and evaluate AI-generated responses for accuracy, reasoning, completeness, and nuance. You will focus on film, television, streaming, and entertainment history while helping identify knowledge gaps and develop benchmark datasets.
This is a part-time contractor role for candidates in the United States, with a time commitment of 20 or more hours per week. The role is listed as entry level, while the requirements call for a master's degree and at least three years of relevant professional experience.
- Role type:
Part-time contractor - Location:
United States - Time commitment: 20+ hours per week
- Primary language:
English - Data type:
Text
You will assess multiple AI responses and explain your judgments with evidence-based reasoning. Your work will help researchers understand where models perform well, where they hallucinate, and how prompts and evaluation benchmarks can be improved.
- Create advanced prompts about films, television series, streaming, actors, directors, genres, awards, franchises, and entertainment history.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback supported by reliable references.
- Compare multiple AI responses, explain why answers are correct or incorrect, and propose improved prompts.
Candidates should bring substantial knowledge of film and television along with strong research and analytical judgment. A master's degree or higher is required, with Film Studies, Television Studies, Media Studies, Journalism, or a related discipline preferred.
The role requires at least three years of professional experience in entertainment journalism, film or television criticism, entertainment media, content creation, research, or analysis. You must be able to assess entertainment-related information accurately and communicate your reasoning in excellent written English.
- Master's degree or higher, with a master's degree in Film Studies or a related discipline requested in the additional requirements.
- 3+ years of professional experience in film or television criticism, entertainment media, or a related field.
- Strong knowledge of movies and television, including history, awards, franchises, genres, actors, directors, and streaming platforms.
- Excellent written English, research, and analytical skills.
- Strong attention to detail and objective judgment.
- Ability to evaluate AI-generated content for factual accuracy and reasoning quality.
Experience with large language models, generative AI, prompt engineering, or AI evaluation is helpful but not required. Published research, industry…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction