AI Evaluation Data Scientist Position

Position: AI Evaluation Data Scientist Position at RBC
Join RBC's AI Group in Toronto, Canada, as a Staff Data Scientist focusing on rigorous model evaluation and risk assessment. Your expertise will refine evaluations, ensuring safety and performance in AI systems.

This senior role emphasizes the design and implementation of comprehensive evaluation frameworks across generative AI and machine learning models. You will guide a team of data scientists, fostering innovation in testing methodologies and establishing evidence-based standards for model quality. Collaborating with various RBC teams, you will translate complex AI evaluation protocols into practical applications.

Key Responsibilities:

• Design methodologies for evaluating ML and agent systems

• Define repeatable standards for quality and safety assessments

• Manage the lifecycle of evaluation datasets

• Collaborate on evaluation processes in production workflows

• Provide mentorship and technical leadership to the team

Requirements:

• 8+ years of relevant experience in data science

• Advanced skills in evaluation frameworks for AI

• Strong background in Python and SQL

• Proven leadership in driving AI initiatives

• Effective stakeholder management skills

Harness your skills in model evaluation to propel RBC towards trusted AI advancements.
#J-18808-Ljbffr