Senior Manager, Intelligence Systems Lab

Overview

Working with Us

Challenging. Meaningful. Life-changing. Those words are often not associated with a job, but at Bristol Myers Squibb they are. Work happens every day across all departments, from optimizing a production line to breakthroughs in cell therapy. This is work that can transform the lives of patients and the careers of those who do it. You’ll have opportunities to grow and thrive through scale and scope, alongside high-achieving teams.

Bristol Myers Squibb recognizes the importance of balance and flexibility in our work environment. We offer a wide variety of competitive benefits, services and programs to help employees pursue their goals, at work and in their personal lives. Read more at

In support of enterprise AI strategy, the Senior Manager of Intelligence Systems Lab conducts research into the principles of intelligence and develops agentic AI systems grounded in rigorous evaluation science. This hands-on technical role focuses on understanding and implementing reasoning, planning, memory, and generalization capabilities for AI agents, while building benchmarking methodologies to assess agent performance. The position supports cross-functional stakeholders in Commercial, Manufacturing, Clinical Development, and Research functions.

• Research and Framework Development
  • Conduct research on reasoning, planning, memory, and generalization architectures for AI agents and multi-agent systems.
  • Develop and test frameworks for agent cognition, including abstraction, goal decomposition, and adaptive planning.
  • Contribute to the lab's understanding of foundational principles underlying intelligent behavior in artificial systems.
  • Stay current with academic literature and industry advances in AI reasoning, cognitive architectures, and agent design.
• Benchmarking and Evaluation Science
  • Design and execute benchmarking experiments to evaluate agent reasoning, reliability, and generalization capabilities.
  • Develop evaluation methodologies for assessing AI agent performance across diverse tasks and domains.
  • Build test harnesses, evaluation datasets, and measurement frameworks for multi-agent systems.
  • Apply rigorous experimental design and statistical analysis to benchmark results.
• Agentic AI Development
  • Serve as a hands-on AI engineer, designing, developing, and deploying advanced agentic solutions.
  • Build multi-agent AI systems using frameworks such as Strands, Lang Graph, DSPy, and similar architectures.
  • Develop RAG (Retrieval Augmented Generation) applications, knowledge graphs, and conversational AI solutions.
  • Implement autonomous workflows that demonstrate advances in reasoning and planning capabilities.
• Rapid Prototyping and Innovation
  • Turn research concepts into working prototypes that demonstrate advances in agent intelligence.
  • Conduct proof-of-concept development to assess feasibility of new reasoning and planning approaches.
  • Seek opportunities to translate research findings into production-ready capabilities.
  • Contribute to documenting research findings, experimental results, and technical methodologies.
• Cross-Functional Collaboration
  • Work cross-functionally with analytics and business stakeholders to pilot AI solutions grounded in research insights.
  • Translate complex AI research concepts into business language to drive understanding and adoption.
  • Partner with the broader Applied Intelligence organization to advance agentic AI capabilities.
  • Engage with Commercial, GPS/Manufacturing, Clinical Development, and Research teams in presenting research-informed solutions.
• Mentorship and Best Practices
  • Contribute to implementing best practices in agent evaluation, benchmarking science, and research methodology.
  • Provide guidance to junior team members on AI/ML techniques, research methods, and development approaches.
  • Support knowledge sharing through internal presentations, documentation, and collaborative research.

• Educational Background BA/BS required (quantitative area such as Computer Science, Data Science, Statistics, Mathematics, Cognitive Science, or Engineering preferred). MS or other graduate degree preferred.
• Technical Proficiency Proficiency in Python (R or Julia), with hands-on experience with ML frameworks (Scikit-Learn, Tensor Flow, PyTorch, etc.). Experience with agentic AI frameworks (Strands, Lang Graph, Auto Gen, DSPy, CrewAI, or similar). Experience with LLMs, prompt engineering, and RAG architectures. Familiarity with benchmarking and evaluation methodologies for AI systems. Proficiency in SQL and experience with cloud environments (AWS, Azure, GCP).
  
  Experience with Git and software version control. Experience with experimental design and statistical analysis preferred.
• Communication Skills Excellent communication and presentation skills, with the ability to explain complex research to technical and non-technical stakeholders. Experience presenting at conferences or publishing research preferred.
• Experience A minimum of 3 years of hands-on experience in…