An interval expresses uncertainty under a method’s assumptions. It does not fix a poor sample, incomplete measurement or confounding.
01STORY BRIEFThe idea in three screens.3 SCREENS
Uncertainty is part of the result.
An interval expresses uncertainty under a method’s assumptions.
Before choosing a formula, identify the independent unit: post, account or campaign. Posts from one account may share common factors. Treating all of them as independent can look overly precise. Publish the method, assumptions and data beyond its reach.
Explain what the interval does not cover: collection errors, selection bias or a changed definition may sit outside its calculation. Readers should distinguish statistical uncertainty from overall measurement quality. This makes a result less dramatic but more useful when deciding whether to act or measure better. Numerical precision should not suppress the practical question of whether the underlying observations represent the population and outcome being discussed.
Show how much the estimate can move
An estimate without uncertainty invites the reader to treat a sample as the whole world. A confidence interval communicates the precision of an estimate under a stated statistical method and its assumptions. It is not a guarantee that the next campaign will land inside the displayed range. Social publishing data can make those assumptions awkward: posts from the same account are related, outcomes are uneven and observation windows differ. A narrow-looking interval produced by pretending every post is independent may communicate more certainty than the design supports.
An estimate needs its context
- 01Unit
Identify what was independently assigned or observed.
- 02Method
State assumptions and how uncertainty was calculated.
- 03Decision
Compare plausible effects with practical costs.
Editorial model: a way to reason about the process, not measured platform results.
Choose the analysis around the experimental unit. If a treatment is assigned by account, do not inflate the effective sample by counting every post as an unrelated trial. Preserve the raw observations, document exclusions and explain the method in language a reviewer can inspect. Alongside uncertainty, report whether the estimated difference would matter operationally after production costs. A statistically precise improvement can still be commercially trivial. When the sample cannot support a useful conclusion, say what additional evidence would change the decision instead of decorating the uncertainty with a confident headline.
“Uncertainty is part of the result.”
02FIELD KITFrom concept to practice.2 SCREENS
Define the unit of analysis.
Adapt this to your audience, budget and test scope.
Put it to work.
- 01Define the unit of analysis.
- 02Explain the method and assumptions.
Notes & sources.
The limit. A narrow interval does not guarantee a properly framed causal question.
Further reading is linked throughout this article. Worked examples explain a process; they are not campaign results.
THE ORGANIC CLUB is an editorial project initiated by TokPortal. That relationship is separate from the evidence behind claims. Editorial signatures and image credits are explained in our policy. Our editorial policy →
