Guardrail Testing Playbook: Margins, Sample Sizes, and Corrected Boundaries

The previous article worked through setting one margin for one guardrail by hand — including the point where the business's first number turned out to need a traffic level ten times the entire user base. Most launches carry several guardrails at once, each needing this same treatment. This article is the reference: precomputed sample sizes across metric types, margin levels, and guardrail counts, plus the decision matrix for turning all of it into an actual ship call.

What's in This Playbook

Two metric archetypes — binomial (conversion-rate-style) and continuous (revenue-style) — each crossed with three margin levels and one to five guardrails, with the β/(G+1) power correction from earlier in this series already baked into every number...

💎

Premium membership required

Upgrade to premium to access the full article.