Data Scientist Specializing in Model Monitoring

Become a key contributor as a Data Scientist specializing in ML and LLM model monitoring and validation. Your expertise will help uphold the integrity and performance of our machine learning systems.

As a Data Scientist reporting to the Director, you'll focus on model validation and build critical evaluation frameworks. You’ll engage in designing custom metrics and regression test suites while collaborating with MLOps teams to ensure model performance remains consistent. Experience in Python and SQL will be essential for overseeing various aspects of model evaluations.

Key Responsibilities:

• Design and implement ML model evaluation frameworks

• Build regression test suites to identify unexpected behaviors

• Conduct MCP evaluations to assess model reliability

• Monitor and address model performance issues proactively

• Clearly document and present evaluation methodologies

Requirements:

• Proven experience in data science or a related field

• Proficient in Python and the data science stack

• Strong understanding of statistical evaluation methods

• High-level SQL skills for data handling

• Effective communication across technical teams

Be the driving force of quality assurance within our ML and LLM systems through expert evaluation and monitoring.
#J-18808-Ljbffr