Senior Efficacy Research and Psychometrics Analyst, Khan Kids

Notice to applicants

We have seen a rise in recruitment scams. Please note that outreach from Khan Academy recruiters will only come from the  domain. Our team does not use Gmail or other personal accounts for contacting potential candidates. Khan Academy will never solicit money, equipment fees, or sensitive financial information at any stage of the hiring process. We also do not work with external recruiting agencies, so outreach from headhunters presenting opportunities on behalf of Khan Academy is illegitimate.

Please always check the email domain and cross-reference the position with the official Khan Academy Careers page to confirm an opening is valid.

Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. Our proven learning platform offers free, high-quality supplemental learning content and practice that cover Pre-K - 12th grade and early college core academic subjects, focusing on math and science. We have over 181 million registered learners globally and are committed to improving learning outcomes for students worldwide, focusing on learners in historically under-resourced communities.

Khan Academy Kids is a free and fun learning program for children ages 2 to 8. Kodi Bear and a cast of animated characters lead children on a personalized education journey filled with fun, standards-aligned activities in early literacy, math, executive functioning and social emotional skills. Built by a small but mighty team, Khan Academy Kids is used by millions of children in homes and classrooms around the world.

Our students, teachers, and parents come from all walks of life, and so do we. Our team includes people from academia, traditional/non-traditional education, big tech companies, and tiny startups. We hire great people from diverse backgrounds and experiences because it makes our company stronger. We value diversity, equity, inclusion, and belonging as necessary to achieve our mission and impact the communities we serve.

We know that transforming education starts in-house with learning about ourselves and our colleagues. We strive to be world-class in investing in our people and commit to developing you as a professional.

Khan Academy Kids is looking for a Senior Efficacy Research and Psychometrics Analyst (24 months fixed-term) to strengthen the evidence base behind our assessments and learning content for children in PreK through 2nd grade.

Responsibilities:

• Lead our psychometric research partnership:
  Serve as the primary technical point of contact for our external psychometric research partnership, supporting study design, data sharing, psychometric analyses, and interpretation of findings
  • Extract, clean, and securely share assessment data with research partners on a recurring schedule
  • Analyze and interpret psychometric findings, including item difficulty, score distributions, growth analyses, concurrent validity, and IRT-based scoring
  • Partner with our product and engineering teams to translate findings into product improvements, such as updates to scoring models and assessment discontinuation rules
  • Collaborate with research partners to develop and publish technical documentation, beginning with the technical manual for our PreK assessment
• Recruit and manage research partner sites:
  Recruit and onboard school and district sites for psychometric and efficacy studies; execute MOUs; align on consent procedures and participant incentives; and coordinate site visits for direct child assessment data collection
• Partner with our legal team to draft and negotiate data-sharing agreements with districts and research organizations, including requirements for pseudonymized and identified data
• Support efficacy research. Coordinate Khan Academy Kids' participation in ongoing efficacy studies and contribute to the design of future studies, aligning internal and external stakeholders on the research approach

• Own Khan Kids’s KPI dashboard:
  Partner with our engineering team to build and maintain the Khan Academy Kids analytics dashboard, including integrations with App Store Connect and Google Play Console. Maintain the dashboard so it can be used by other teams including marketing, school partnerships, and philanthropy.
• Lead recurring reporting:
  Prepare recurring app performance reporting, including monthly and quarterly business reviews and…