Multilingual Inpatient Hospitalist AI Evaluator

About Open Train

Open Train is the #1 platform for finding and building careers in AI training and data labeling. Open Train AI recruits contributors for specialized projects where expert human judgment helps improve how artificial intelligence understands and generates information.

As an Open Train contributor, you can discover work that matches your expertise, build a professional AI training profile, and apply in minutes. Creating an Open Train account is free.

AI training is the human side of building modern artificial intelligence. In this work, physicians review examples, identify errors, and provide structured feedback so AI systems can produce more accurate, complete, and clinically sound results.

This role focuses on inpatient H&Ps, progress notes, discharge summaries, and encounter data. Your clinical judgment will help shape documentation tools while giving you flexible, remote access to cutting-edge AI work.

Open Train AI is seeking a Multilingual Inpatient Hospitalist for clinical documentation AI evaluation. You will assess inpatient documentation and AI-generated notes against hospitalist documentation standards, detailed guidelines, and evaluation rubrics.

This is a remote, part-time contractor position for US-based workers. The schedule is flexible around an active clinical practice, with a minimum availability of 10 hours per week and a time requirement of less than 20 hours per week. The pay rate is $170 per hour.

• Remote contract work for US-based workers
• Part-time schedule with at least 10 hours of availability per week
• Flexible scheduling around current inpatient clinical practice
• Pay rate of $170 per hour

You will use hands-on hospitalist documentation experience to evaluate clinical content carefully and consistently. Your written feedback will help engineering and product teams improve AI systems and refine evaluation processes.

The work includes reviewing both source documentation and AI-generated notes, annotating encounter data, and contributing expert input when guidelines or clinical edge cases require clarification.

• Evaluate inpatient documentation and AI-generated notes for accuracy and completeness
• Assess clinical soundness and alignment with hospitalist documentation standards
• Review H&Ps, progress notes, discharge summaries, and encounter data
• Identify omissions, hallucinations, inaccuracies, and documentation gaps
• Annotate encounter data using detailed guidelines and consistent rubrics
• Provide structured written feedback for engineering and product teams
• Contribute expert input on annotation guidelines, documentation standards, and ambiguous edge cases

This role requires an MD and current practice as an inpatient hospitalist or internal medicine physician. Candidates must have at least two years of post-residency experience and hands-on experience writing and reading inpatient H&Ps, progress notes, or discharge summaries.

You must be eligible to work in the US and demonstrate advanced C1-level or higher proficiency in speaking, listening, and writing English. You must also have C1-level or higher proficiency in at least one additional supported language.

• MD qualification
• Current inpatient hospitalist or internal medicine practice
• At least two years of post-residency experience
• US-based work eligibility
• Hands-on judgment when reviewing H&Ps, progress notes, and discharge summaries
• Ability to identify clinical omissions, hallucinations, inaccuracies, and documentation gaps
• Advanced C1-level or higher speaking, listening, and writing ability in English and another supported language
• Strong written communication and careful attention to detail
• Ability to follow detailed guidelines and apply evaluation rubrics consistently

In addition to advanced English proficiency, candidates must be highly proficient in at least one of the following supported languages:

• Spanish, Chinese (Mandarin), Chinese (Cantonese), Tagalog, Russian, Haitian Creole, Korean, or Arabic
• Portuguese, Polish, Japanese, Turkish, Italian, Ukrainian, Romanian, Finnish, or French
• Danish, Catalan, Hungarian, Czech, German, Bulgarian, Indonesian, or Dutch

Every major AI system depends on people who can review examples, recognize subtle errors, and explain what high-quality results should look like. Specialized contributors bring the professional judgment that automated systems cannot provide on their own.

AI training work is remote and often flexible, making it possible to contribute to emerging technology while fitting projects around clinical responsibilities. Your Open Train profile can help you show credible experience and build a long-term portfolio in this growing field.

• Apply your clinical expertise to state-of-the-art AI systems
• Work remotely with flexible part-time scheduling
• Build an AI training portfolio around specialized medical experience
• Help improve the accuracy and reliability of clinical documentation tools