Lesson
Uncertainty Needs Ranges
A measured number is usually a best estimate with sampling wobble around it, so honest comparisons need ranges as well as point estimates.
By the Math Says Yes editorial team
Human-reviewed under our source and correction standards.
How we review content
The point is not the whole estimate
A poll, experiment, or survey rarely measures an entire . It measures a and then uses that sample to estimate a larger truth. The reported number is the center of the estimate, not the full story. Another sample from the same population would usually land a little higher or lower. A range communicates that sampling wobble directly, so the reader can see the precision of the estimate instead of mistaking a point for certainty.
What confidence means
A 95% is easiest to understand as a method, not as a mystical property of one finished interval. If you repeated the same sampling process again and again, and built an interval the same way each time, about 95% of those intervals would contain the true value. Once one interval is computed, the true value is either inside it or outside it. The confidence describes the long-run reliability of the procedure.
Comparing ranges
Ranges are especially useful when comparing two numbers. A candidate leading by three points in a poll with a three-point may not truly be ahead. A product rated 4.7 from a tiny may not be better than one rated 4.5 from thousands of reviews. The question is not only which point estimate is bigger. It is whether the uncertainty around the estimates leaves room for the ordering to reverse.
How to use it
When you see a measured number, look for the range. If none is given, ask how big the was and how the data were collected. Treat narrow intervals as more precise, wide intervals as less settled, and overlapping intervals as a warning against confident ranking. The range does not remove judgment; it makes the judgment honest by showing how much room random still has to move the result.
FAQ
Is a confidence interval the same as a margin of error?
They are closely related. A margin of error is often the plus-or-minus distance around a survey estimate, while the confidence interval is the full range formed by applying that distance to the estimate.
Do overlapping intervals always prove there is no difference?
No. Overlap is a quick caution, not a full statistical test. It means the comparison is less clear from the displayed ranges alone and needs a direct test or more precise estimate.
Core Concepts
Confidence Intervals
A confidence interval is a range produced by a method that captures the true value a stated share of the time across repeated samples. It describes uncertainty in the estimating method, not a personal guarantee that one already-computed interval contains the truth.
Margin of Error
A margin of error is the plus-or-minus range around a survey estimate caused by sampling uncertainty. If two estimates have overlapping uncertainty ranges, the apparent leader may not be truly ahead.
Uncertainty
The honest range left after measurement limits, model choices, and missing information. A single number can be useful as a midpoint, but decisions usually need plausible low and high values too. Good estimates state the assumptions that would move the answer.
See it in action
A 95% confidence interval is not a 95% promise
Confidence intervals are honest ranges around estimates, but the confidence level belongs to the long-run method that created the range.
A three-point poll lead can still be a tie
Margins of error remind us that poll numbers are estimates. When uncertainty ranges overlap, the apparent ranking can be too close to call.
P-value vs confidence interval: what each one tells you
P-values and confidence intervals answer different questions. Use the p-value for evidence against a null model, and the interval for the size and uncertainty of the effect.
Try the idea
P-value vs. confidence interval
Move the estimate and watch both summaries change.
estimate: +1.5
null value
estimate
-0.5 to +3.5
95% interval
.134
p-value
At an estimate of +1.5, the 95% interval still spans the null value and p = .134. The two agree: an interval that includes 0 is exactly the case where p stays above 0.05.
Quick Check
What does a 95% confidence interval describe most precisely?
A
A method that would capture the true value in about 95% of repeated samples.
B
A range containing 95% of all individual observations.
C
A 95% probability that this exact finished interval contains the value.