Five Questions That Tell You Whether Your Experimentation Programme Is Working
Five diagnostic questions that cut through the activity reports. You do not need a technical background to ask them.
Practical guides for teams that run experiments and research, and the leaders who need them to inform decisions.
Five diagnostic questions that cut through the activity reports. You do not need a technical background to ask them.
Spotting phantom revenue, cherry-picked results, and activity dressed as impact in your team's presentations.
Red flags that the programme is generating activity, not learning. Most of them are invisible from the quarterly report.
Executives, a senior owner, and practitioners each have a distinct job. Most programmes have all three doing the wrong one.
A mandate is issued once. It is enforced continuously, or it decays into a slide nobody acts on.
Six metrics that actually tell you about programme health. Most teams cannot produce any of them.
Breaking the buzzword into observable, measurable behaviours. If you cannot measure it, you do not have it.
Every programme has a person who holds it together. What happens when they leave.
The question is not whether you run experiments well. It is whether experiments change decisions.
Six structural problems your experimentation team knows about but the incentives do not reward raising.
Five diagnostic questions that cut through the study count. You do not need a research background to ask them.
Spotting confirmation bias, findings that flatter the brief, and observations labelled as insights.
Red flags that the programme is generating studies, not influence.
Six metrics that tell you about programme health. Most teams cannot produce any of them.
Breaking the buzzword into observable, measurable behaviours.
Two years of user research in someone's head, their Google Drive, and their personal Notion.
Research concludes on Tuesday. The product decision it should inform was made three weeks ago.
Six structural problems your research team knows about but the incentives do not reward raising.
Start with what you already know, not what you think. A step-by-step guide to grounding new ideas in evidence.
What a new joiner needs in their first month, and why most of it probably is not documented.
The six elements every brief needs. Most teams get one or two right and skip the rest.
Connecting experiments to what leadership cares about. Not retrospectively. Structurally.
Ninety minutes to turn a dumping ground into a pipeline. How to prune, reprioritise, and reconnect to objectives.
A quality gate that catches weak plans before they cost time. How to set one up without creating a bottleneck.
Governance survives only when it can refuse and when it gives value back. How to build both in from the start.
The three things a small team needs before anything scales. Deliberately small, so nobody can plead bureaucracy.
If success is defined after the results arrive, every test wins. How to register the call before the data exists.
A rejection is a decision, and decisions deserve records. Why the same idea keeps coming back, and how to stop it.
Claimed wins that never survive scrutiny are the quickest way to lose leadership trust. A protocol for checking.
What to do when the test loses. How to extract value and prevent the learning from being discarded.
The difference between findings and insights. Findings describe what happened. Insights drive what happens next.
Duplication is invisible, expensive, and more common than anyone admits. Here is how to prevent it.
A structure that shows impact, not activity. Results, decisions, learnings, and a clear ask.
Getting teams to learn from each other's experiments. Not a broadcast. A working session.
What the report should contain and why most of the data it needs probably requires manual reconstruction.
Building support with evidence, not enthusiasm. How to make the case that survives a budget conversation.
The resignation test. What your programme would lose if the key person left on Friday.
A structured diagnostic across five dimensions. Score honestly and see where the gaps are.
When the programme has lost momentum, where to start and what to fix first.
The difference between a request and a brief. Seven elements every brief needs before the research begins.
Connecting this quarter's study to last year's survey to the interviews from eighteen months ago.
What a new researcher needs in their first month, and why most of it probably is not documented.
Format, structure, and making findings land in the format stakeholders actually consume.
Duplication is expensive, common, and invisible. Here is how to prevent it.
Findings are not recommendations. Recommendations are not decisions. Most research stops at findings.
Twelve incoming requests, capacity for four. How to choose and how to say no with evidence.
The difference between observations and insights. Most research stops at observations.
What the report should contain and why assembling it probably takes a week when it should take a day.
The resignation test. What your programme would lose if the key person left on Friday.
A structured diagnostic across five dimensions. Score honestly and see where the gaps are.
The most politically dangerous moment in research. What to do when the findings are unwelcome.