Manager Digital Experimentation

OVERVIEW

Discover the possibilities of our progressive, omnichannel approach to beauty retail. At Ulta Beauty, our E-commerce associates sit at the cutting edge of our efforts to reimagine the future of retail. Through a full suite of new and emerging technologies, this team is creating an enhanced buying experience for guests who crave simplicity, choice, personal insights and the joy of discovery.

With greater interactivity. Inspired applications of big data, AI and UI/UX. And creative that persuades and delights. All of this, with the opportunity to experience smart ideas come to life.

At Ulta Beauty, we’re forever imagining. Forever striving. Forever investing in next-gen—with deep and rich opportunities for ongoing learning, growth and advancement. We encourage you to take control of your career and set your own ceiling. For curious and big-picture thinkers who can flex to the need and who want to stretch themselves through courage and conviction, Ulta Beauty provides an environment perfectly suited to your ambitions.

Let’s build brilliant together.

The Manager of Experimentation & Testing supports the strategy, execution, and ongoing optimization of digital experimentation across our eCommerce ecosystem – both web and app. This role is responsible for helping drive data-driven decision-making by designing and implementing robust testing frameworks that optimize digital experiences and customer journeys and drive incremental business growth.

The ideal candidate is a collaborative experimentation practitioner who thrives on cross-functional collaboration, can translate complex data into clear business insights across various organizational levels, is passionate about leveraging best practices, and can support and guide team members and their development.

• Contribute to the development and execution of the enterprise-wide A/B and Multivariate testing roadmap to drive digital growth and improve customer engagement.
• Partner with cross-functional teams across digital teams to identify high-impact testing opportunities aligned with strategic business goals.
• Promote a test-and-learn culture, ensuring experimentation is integrated into eCommerce strategies and the digital development lifecycle.
• Support the implementation and refinement of best practices, frameworks, and governance processes for experimentation across teams.
• Collaborate closely with Product PODs, Digital Experience, UX/UI Design, Content, Merchandising, and Marketing to define hypotheses, scope and prioritize tests, and align on success metrics.
• Serve as the key coordinator for all testing initiatives, ensuring transparency and coordination across business units.
• Oversee the design, setup, execution, and analysis of A/B/n tests using Adobe Target and other experimentation platforms (A/B Tasty).
• Partner closely with Personalization and Strategic Analytics teams to support the growth of the Personalization program through testing and analysis execution – integrating results with Customer Journey Analytics (CJA) data.
• Translate statistical results into clear, actionable recommendations for business partners.
• Deliver concise readouts summarizing test outcomes, insights, and strategic implications.
• Provide guidance and day-to-day support to analysts and testing specialists and oversee their development and professional growth.

• Education:
  
  Bachelor’s Degree in Analytics, Statistics, Data Science, Marketing, or related field.
• Experience:
  
  5–7 years of experience in digital experimentation, A/B testing, or conversion optimization – within eCommerce and retail environment preferred.
• Experience supporting or coordinating testing programs; people-leadership experience a plus.
• Advanced proficiency in Adobe Target, with proven success managing hands-on testing programs.
• Strong understanding of Adobe Analytics, with Customer Journey Analytics (CJA) experience preferred.
• Demonstrated ability to translate complex analytical findings into strategic insights for cross-functional partners.
• Excellent collaboration, communication, and stakeholder management skills across technical and…