Machine Learning Validation & Data Operations Manager

* Lead data labeling effort to build ground-truth corpus for existing and future algorithms, including identifying data requirements and protocols.
* Determine validation criteria and metrics across models and settings/partnerships/use cases.
* Collaborate with data management teams, and application development teams to identify and capture the data necessary to perform validation.
* Recruit, train, and lead a team of data labelers.
* Ensure alignment between the validation roadmap and Center’s priorities.
* Establish timelines and strategies for the validation of different algorithms.
* Work with ML and engineering teams to develop and manage pipelines for continuous algorithm validation and optimization.
* Promote advances in, and creative ML solutions for validation and data management enhancement (e.g., automation of protocols and training pipelines).
* Build quality assurance processes to continuously assess reliability of data.
* Maintain comprehensive records of data sources, methodologies, and results.
* Establish best practice-based processes related to reproducibility, documentation, and version control.
* Investigates, analyzes and resolves day-to-day technical problems using standard procedures.
* Works with stakeholders to gather and analyze requirements for developmental programs. Receives a moderate level of guidance to design applications to meet University and business requirements.
* Performs code testing on components and works to ensure that appropriate implementation standards are met. Evaluates design alternatives for development cost and solutions using various methods.
* Supports and maintains existing applications. Works with web developers and responds to requests from users.
* Performs other related work as needed.
* Knowledge and skills developed through 5 years of work experience in a related job discipline, strongly preferred.
* 2 years of experience managing people, strongly preferred.
* Prior experience setting up data labeling and validation processes.
* Demonstrated understanding of data science management, Machine Learning and Data operations.
* Experience building out ML operations teams and processes.
* Experience with statistical modeling and programming.
* Demonstrated ability to work independently with little supervision.
* Excellent strategic planning and execution skills.
* Strong problem-solving skills.
* Ability to balance short-term, long-term, and big picture objectives.

When applying, the document(s)
** MUST
* * be uploaded via the
** My Experience
** page, in the section titled
** Application Documents
** of the application.

The University of Chicago is an urban research university that has driven new ways of thinking since 1890.

Our commitment to free and open inquiry draws inspired scholars to our global campuses, where ideas are born that challenge and change the world.

We empower individuals to challenge conventional thinking in pursuit of original ideas. Students in the College develop critical, analytic, and writing skills in our rigorous, interdisciplinary core curriculum. Through graduate programs, students test their ideas with UChicago scholars, and become the next generation of leaders in academia, industry, nonprofits, and government.

To learn more about the university
#J-18808-Ljbffr