Statistical Power in A/B Testing: Avoiding False Negatives
Learn what statistical power means for A/B testing, why 80% is the standard, and how underpowered tests lead to costly false negatives that cause you to…
Read Article→
Free Learning · Better Decisions Make Growth Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical guides for analysts, growth teams, and founders.
Sample Size Calculation for A/B Tests: Getting It Right Before You Start
Master A/B test sample size calculation including the relationship between baseline conversion rate, minimum detectable effect, and statistical power to…
Read Article→
P-Values Demystified: What They Actually Mean for Your A/B Tests
Understand what p-values really mean in A/B testing, why common interpretations are wrong, and how to use statistical significance correctly for business decisions.
Read Article→
One-Tailed vs Two-Tailed Tests: Does It Actually Matter?
Understand the difference between one-tailed and two-tailed hypothesis tests in A/B testing, when each is appropriate, and the simple conversion rule between them.
Read Article→
Bayesian vs Frequentist A/B Testing: What Practitioners Need to Know
A practical guide to the Bayesian vs Frequentist debate in A/B testing, why it matters less than you think, and what practitioners should actually focus on…
Read Article→
How Long Should You Run an A/B Test? The Complete Duration Guide
Learn the science behind A/B test duration, why stopping at significance is dangerous, and how to determine the right test length using sample size…
Read Article→
Confidence Intervals and Margin of Error: Reading A/B Test Results Correctly
Learn how to interpret confidence intervals and margin of error in A/B test results, why your conversion rate is always an estimate with uncertainty, and…
Read Article→
User Testing for Conversion: Watching Real Users Navigate Your Product
User testing reveals the gap between how you designed your product and how people actually experience it.
Read Article→
How to Write A/B Test Hypotheses That Actually Generate Insights
A strong hypothesis is the difference between an experiment that teaches you something and one that wastes traffic.
Read Article→
Mouse Tracking and Heat Maps: What They Actually Tell You (And What They Don't)
Heat maps and session replays are seductive but easy to misinterpret. Learn how to use click maps, scroll maps, and form analytics to generate real insights…
Read Article→
Technical Analysis: The Low-Hanging Fruit Most Optimizers Miss
Technical bugs and performance issues silently destroy conversion rates.
Read Article→
Conversion Research: The Foundation of Every Winning A/B Test
Most A/B tests fail because they skip the research phase. Learn how conversion research — from heuristic analysis to qualitative methods — builds the…
Read Article→
Qualitative Research for CRO: Why Numbers Alone Aren't Enough
Quantitative data tells you what is happening on your website. Qualitative research tells you why.
Read Article→
Heuristic Analysis for Conversion Optimization: A Systematic Framework
Learn the five-dimension heuristic evaluation framework — relevancy, clarity, value, friction, and distraction — and how to score pages systematically for…
Read Article→
Regression to the Mean: Why Your A/B Test Winner Might Disappear
Regression to the mean explains why early A/B test results often look dramatic but fade over time.
Read Article→
Multivariate Testing vs A/B Testing: Which Should You Use?
Understand how multivariate testing works, when it outperforms A/B testing, the traffic requirements for MVT, and why most programs run roughly ten A/B…
Read Article→
A/B/n Testing Explained: When and Why to Test Multiple Variants
Learn what A/B/n testing is, how traffic splits work with three or more variants, when you need multiple variants, and the tradeoffs compared to simple A/B tests.
Read Article→
False Positives in A/B Testing: The Silent Killer of Growth Programs
Why false positives are the biggest threat to A/B testing programs, how A/A tests prove the problem is real, and why stopping at significance is the number…
Read Article→
What Is A/B Testing? The Definitive Beginner's Guide
A complete beginner's guide to A/B testing — how controlled experiments work, why they matter for business decisions, and how split testing reduces the risk…
Read Article→
The Novelty Effect: Why Your A/B Test Winner Might Be Temporary
How the novelty effect inflates early A/B test results, why visual changes attract temporary attention, and how to distinguish genuine improvements from…
Read Article→
Bandit Algorithms in Experimentation: Balancing Exploration and Exploitation
How bandit algorithms dynamically reallocate traffic to winning variants, when they outperform traditional A/B tests, and why the exploration-exploitation…
Read Article→
The Split Testing Glossary: Every Term You Need to Know
A comprehensive glossary of A/B testing and experimentation terminology — from statistical significance and p-values to novelty effects and regression to the mean.
Read Article→
Narrative Transportation Theory: Why Story-Driven Landing Pages Outperform Feature Lists
Narrative transportation theory explains why users who become absorbed in a story lower their critical defenses, making story-driven landing pages…
Read Article→
The Generation Effect: Why Interactive Content Converts Better Than Passive Content
The generation effect from cognitive psychology demonstrates that information people actively generate is remembered better than information they passively…
Read Article→
Better Decisions
Make Growth Decisions
You Can Defend
Know what to test, when to trust the result, and what to do next. Practical decision guides for analysts, growth teams, and founders. Free. Weekly.
Opens Substack to confirm your subscription · Free · Unsubscribe anytime