
Senior Experimentation Manager
- London
- Permanent
- Full-time
- Think without limits - Think fast, think fearlessly, and take the team with you
- Own it and back yourself - Own the basics, own your role and own the results
- Be relevant - Relevant to our people, our partners and the planet
- Define and champion experimentation standards across both client-side and server-side A/B testing.
- Lead the delivery of a consistent framework for hypothesis-led testing - from conversion rate optimisation to new product validation.
- Be the go-to expert on causal inference and offsite experimentation approaches to measure marketing and media impact when A/B testing isn't possible.
- Manage a small team of 3 direct reports.
- Act as a central advisor across Product, Trade, Personalisation, and Marketing functions, coaching teams on experimentation thinking.
- Embed test-and-learn principles into product development lifecycles and roadmap decisions.
- Govern the experimentation pipeline to ensure alignment with commercial priorities and speed of learning.
- Partner with analytics / implementation to ensure meaningful KPIs, robust implementation, and actionable insight from every test.
- Drive knowledge sharing of experimentation learnings across brands, platforms, and functions.
- Bring visibility to where we're learning fastest - and where we need to invest to improve.
- Own and evolve how we use our experimentation stack - Optimizely, Twillio Segment, GA4, and ContentSquare - ensuring it's integrated and fit for purpose.
- Collaborate with engineering and data teams to ensure measurement accuracy and data integrity at scale.
- Experience designing and scaling experimentation programs in a fast-paced e-commerce or digital product environment.
- Strong understanding of A/B testing methodologies, including client-side and server-side execution.
- Familiarity with offsite experimentation techniques like causal inference / geo-testing.
- Proven ability to partner with cross-functional teams and influence product, marketing, and trading stakeholders.
- Hands-on experience with experimentation tools, ideally Optimizely, and measurement platforms like GA4 and ContentSquare.
- Experience operating within a multi-brand retail ecommerce environment
- Exposure to personalisation programs or feature flagging at scale.