Experimentation Lead, Sign-Up and Cancellation Optimization

45732

Burbank, CA, US, 91505 West Hollywood, CA, US, 90069

Technology

Burbank

Full-Time

On-Site

Storytelling is, and will always be, the heart of what we do at Skydance.
Our vision is to build a thriving entertainment ecosystem where stories and worlds are imagined, brought to life and experienced. We create for every age and audience, anchored by the strength of our content and experiences and the depth of our connection with fans. We are creator-first, audience-focused, tech-forward, globally scaled.

Here, you’ll work with talented teams that move fast, think boldly and collaborate with purpose to deliver results. We aim high, champion the best ideas and win together, earning the trust of our employees, creators, partners and audiences every day.

If you’re energized by the opportunity to help build the next‑generation global media and entertainment company powered by creativity and technology, we’d be thrilled to welcome you aboard. LET’S GO!

Paramount Streaming is investing heavily in personalization, experimentation, and applied AI to shape how millions of viewers begin — and continue — their journey with Paramount+ and Pluto TV. We are seeking an Experimentation Lead to own and scale experimentation across the sign‑up and cancellation flows. This is a highly strategic and execution‑oriented role focused on identifying, prioritizing, launching, and scaling experiments that directly impact conversion, retention, and lifetime value.

Reporting to the Principal Machine Learning Engineer for Sign‑Up Optimization, you will act as the connective tissue between product, ML, engineering, data science, design, and growth — ensuring we are running the right experiments, running them well, and learning from them rigorously. This role blends product thinking, scientific rigor, experimentation design, and operational management.

Experimentation Strategy & Road mapping

• Define and own the experimentation roadmap across sign‑up, onboarding, and cancellation flows for Paramount+ and Pluto TV.
• Identify high‑impact test opportunities across UX, messaging, offers,personalization, pricing, bundling, and model‑driven experiences.
• Translate business goals (conversion, churn reduction, engagement, LTV) into structured, testable hypotheses.
• Prioritize experiments using data‑driven frameworks balancing impact, risk, and resource constraints.

• Partner with ML engineers and applied scientists to test model‑driven experiences(ranking, personalization, content ordering, offer targeting).
• Ensure experiment configurations are correctly implemented and debug issues in targeting, logging, or exposure.
• Monitor live experiments for integrity, guardrail breaches, or unintended side effects.
• Lead post‑test readouts and translate results into clear, actionable next steps.

• Design robust A/B, multivariate, and sequential testing frameworks.
• Define primary metrics, guardrails, and success criteria aligned to long‑term value,not just short‑term conversion.
• Improve offline‑to‑online validation practices in partnership with ML teams.
• Standardize experimentation best practices across the Applied Intelligence group.
• Champion causal reasoning and statistical discipline in decision‑making.

• Partner closely with Product, Growth, Marketing, Design, Data Science, Analytics, and Engineering.
• Serve as the central point of coordination for experimentation across the lifecycleentry/exit flows.
• Communicate insights clearly to both technical and executive audiences.
• Create scalable documentation and experiment tracking processes.

• 3–5+ years of experience in experimentation,…