Experimentation Lead, Sign-Up & Retention

#We Are Paramount  on a mission to unleash the power of content… you in?

We’ve got the brands, we’ve got the stars, we’ve got the power to achieve our mission to entertain the planet – now all we’re missing is… YOU! Becoming a part of Paramount means joining a team of passionate people who not only recognize the power of content but also enjoy a touch of fun and uniqueness. Together we co‑create moments that matter for our audiences and our employees.

Team:
Applied Intelligence

Company:
Paramount Streaming (Paramount+, Pluto TV)

Paramount Streaming is investing heavily in personalization, experimentation, and applied AI to shape how millions of viewers begin – and continue – their journey with Paramount+ and Pluto TV. We are seeking an Experimentation Lead to own and scale experimentation across the sign‑up and cancellation flows. This highly strategic and execution‑oriented role focuses on identifying, prioritizing, launching, and scaling experiments that directly impact conversion, retention, and lifetime value.

Reporting to the Principal Machine Learning Engineer for Sign‑Up Optimization, you will act as the connective tissue between product, ML, engineering, data science, design, and growth, ensuring we run the right experiments well.

• Define and own the experimentation roadmap across sign‑up, onboarding, and cancellation flows for Paramount+ and Pluto TV.
• Identify high‑impact test opportunities across UX, messaging, offers, personalization, pricing, bundling, and model‑driven experiences.
• Translate business goals into testable hypotheses.
• Prioritize experiments using data‑driven frameworks balancing impact, risk, and resources.
• Drive experiments from ideation → design → instrumentation → launch → feedback → iteration.
• Partner with ML engineers and scientists to test model‑driven experiences.
• Ensure experiment configurations are correctly implemented and debug issues.
• Monitor live experiments for integrity and guardrails.
• Lead post‑test readouts and translate results into actionable next steps.
• Design robust testing frameworks.
• Define metrics, guardrails, and success criteria.
• Improve offline‑to‑online validation practices.
• Standardize experimentation best practices.
• Champion causal reasoning and statistical discipline.
• Partner closely with Product, Growth, Marketing, Design, Data Science, Analytics, and Engineering.
• Serve as central coordination point for experiments across lifecycle flows.
• Communicate insights to technical and executive audiences.
• Create scalable documentation and experiment tracking processes.

• 3–5+ years of experience in experimentation, growth, product analytics, applied ML, or related quantitative roles.
• Proven track record designing and executing high‑impact A/B tests in high‑scale consumer digital products.
• Deep fluency in experimentation methodology: statistical inference, power analysis, guardrails, sequential testing, causal reasoning.
• Experience working closely with ML‑driven systems (recommendation, ranking, personalization) in production.
• Strong analytical toolkit (SQL required; Python/R preferred).
• Ability to debug experiment integrity issues.
• Product intuition and ability to translate ambiguous business questions into testable frameworks.
• Excellent stakeholder management and executive‑level communication.

• Experience in subscription businesses, streaming media, or lifecycle optimization.
• Familiarity with experimentation platforms and feature‑flag systems.
• Background in growth, pricing optimization, offer testing, or churn reduction strategies.
• Experience working in ML‑first or AI‑driven product environments.

• Impact:
  Shape how millions of users start and end their relationship with Paramount’s streaming products.
• Ownership:
  Define the experimentation engine for critical journeys.
• Influence:
  Work with senior ML leaders and shape personalization and growth across the company.
• Scale:
  Help build systems that operate at global streaming scale.

• Hiring salary range: $ – $ (varies by location).
• Benefits: medical, dental, vision, 401(k), life insurance, disability, tuition assistance, PTO, bonus eligibility.
• Paramount is an equal‑opportunity employer and is committed to inclusion across race, color, ethnicity, gender identity, veteran status, and disability.