Experimentation Advocate

About the role

We are looking for a data scientist to join our team to drive the conversation around digital experimentation and Growth Book, work directly with active and prospective Growth Book customers to ensure their experimentation programs are healthy, and help shape the roadmap for the Growth Book product. This role is fully remote, but we do prefer candidates in US time zones so everyone has some overlapping work hours.

As an early employee, you will have an immense impact on the product and business.

• Solving Challenging Customer Needs. Growth Book’s customers often have multiple teams with different experimentation needs. Some teams will be experimenting across logged-in and logged-out tracking events; some teams will need to use pre-aggregated metrics and others will be working with raw event data; some teams will want to ship as early as they can rule out harm, and others will only want to ship clear winners.
  
  Answering these and other technical questions with both prospective and onboarding customers, as well as fielding experimentation-focused feature requests, will be an important part of the experimentation advocate’s roles.
• Improving the Quality of Experimentation Discourse
  . Advice online about best practices in experimentation can be fragmented or come from a particular perspective. As an open-core experimentation platform, Growth Book serves a wide variety of experimenters with a wide variety of needs. To serve this community, the person in this role will be writing articles and engaging with online conversations about experimentation best practices and how to implement them with Growth Book.
  • Example questions:
    How can I think about the trade-offs between sequential testing and classical frequentist testing? What is the best way to measure long-term user behavior in a short-term test? How should I organize my data warehouse for efficient experiment and product analytics? Why is post-stratification on top of CUPED powerful for my use case?
  • Other possible projects: A summary of the state of experimentation on Growth Book; building a library of successful experiments.
• Leading the Internal Conversation about Experimentation Best Practices. In addition to serving as the external voice of Growth Book, the experimentation advocate will attend conferences to speak, stay abreast of new developments, and share their knowledge and learnings with the team. This also means using your experience and knowledge to help shape the future of Growth Book so it can stay at the cutting edge of experimentation practice.

• Expert in digital experimentation, with 2+ years working on or with a large scale experimentation platform
• PhD or Masters background in statistics, or equivalent experience
• Solid understanding of SQL and data warehouses
• Experience working with internal or external stakeholders with experimentation needs
• Fluent English and good communication skills
• Startup experience or interest working in a small company
• Bonus: Contributed to an open-source project
• Bonus: Ability to contribute to
• Bonus: Used feature flags or A/B testing at a previous company
• Bonus: Experience with building experimentation or product analytics tooling

• 100% remote work from anywhere (within US time zones)
• Health, Vision, and Dental benefits (we cover 100% of the cost for employees and 95% for dependents - though if located outside the US, benefits may vary)
• Generous tech stipend for your home office (or coworking space)
• Regular off-sites in exciting places

Growth Book is an equal opportunity employer and is committed to creating an inclusive, supportive environment for all employees.

We regret that we cannot sponsor employment visas at this time, although we can make exceptions for H1B transfers.