Graduate Research Assistant; LLM Interaction and Statistical Analysis

Graduate Research Assistant (LLM Interaction and Statistical Analysis)

Under the direction of the Learning Lab leadership team, the employee will contribute to the design and implementation of research involving medical learners' interactions with generative AI tools. The appointment is on a semester-by-semester basis. This position is expected to run through December 2026 with further extension expected. Position is eligible for Tuition Reduction Benefit (TRB) and is determined by the number of hours employed per week during the semester.

The GRA will work extensively with LLM-related data, including chat transcripts, structured interaction logs, usage metadata, and quantitative evaluation measures (e.g., rubrics and surveys). The primary emphasis of this role is statistical and computational analysis of clinician–LLM interactions and their relationship to clinical reasoning outcomes. This role provides hands-on experience at the intersection of data science, clinical reasoning research, and human–AI interaction, contributing to empirical analyses of how LLMs are used in real clinical reasoning tasks.

Responsibilities

• Analyze LLM chat logs and interaction metadata (e.g., turn taking, prompt types, revision behavior)
• Conduct statistical analyses combining LLM data with structured measures (rubrics, surveys)
• Support mixed methods synthesis in collaboration with qualitative researchers
• Prepare internal analytic memos documenting methods, findings, and implications
• Contribute figures, tables, and methods text for academic papers and white papers

• Bachelor's degree in data science, cognitive science, psychology, informatics, communication, social science, or related field.
• Experience working with quantitative data and computational analysis.
• Experience conducting statistical or computational analysis
• Experience working with text-based or interaction data (e.g., chat logs)
• Familiarity with R or Python preferred
• Strong organizational skills and attention to detail.
• Ability to manage secure data and respect confidentiality protocols.
• Ability to work independently and collaboratively.

• Minimum of Master's level coursework in data science, informatics, psychology, or related fields.
• Experience with Python or R for text analysis, NLP, or data wrangling.
• Experience with human–AI interaction or clinical/medical education settings.
• Experience contributing to IRB submissions.

$33,108

• Typical office environment
• Remote work environment with occasional in-person meetings
• GRA's will use their own computers

• Fall/Spring Semesters: up to 20 hours per week;
  Summer months up to 40 hours per week.
• M-F, 8 am - 5 pm
• Nominally, in-person at the IC2 Institute, however, some occasional remote work is currently permitted
• Flexible hours to be arranged with supervisor

• Resume/CV
• 3 work references with their contact information; at least one reference should be from a supervisor and at least one reference should be from a faculty member familiar with the student's related skills and experience.
• Letter of interest