What Is a Sampling Distribution?
Imagine drawing 1,000 random samples of size 50 from the same population. Each sample produces a slightly different mean. Plot all 1,000 of those means on a histogram, and what you get is the sampling distribution of the sample mean. That distribution — not the original population, not any single sample — is what inferential statistics runs on.
Three distinct distributions are easy to confuse, and the confusion leads to real errors in calculations:
| Distribution | What it describes | Shape | Spread parameter |
|---|---|---|---|
| Population distribution | Individual values in the full population | Any shape (skewed, bimodal, uniform…) | σ (population SD) |
| Sample distribution | Individual values in one sample | Approximates population shape | s (sample SD) |
| Sampling distribution | Values of a statistic across many samples | Approaches normal (CLT) | SE = σ/√n |
A sampling distribution is the probability distribution of a sample statistic (such as the mean or proportion) computed from all possible samples of a fixed size n drawn from the same population. Its mean equals the population parameter (unbiasedness), and its spread is measured by the standard error, which shrinks as n increases.
Building a Sampling Distribution from Scratch
The best way to understand sampling distributions is to build one from a tiny, enumerable population. Suppose a population has just four exam scores: 60, 70, 80, 90. The population mean is μ = (60+70+80+90)/4 = 75.
Now draw every possible sample of size n = 2 with replacement. There are 4² = 16 possible pairs. Each pair has its own sample mean:
| Sample pair | x̄ | Sample pair | x̄ |
|---|---|---|---|
| (60, 60) | 60 | (80, 60) | 70 |
| (60, 70) | 65 | (80, 70) | 75 |
| (60, 80) | 70 | (80, 80) | 80 |
| (60, 90) | 75 | (80, 90) | 85 |
| (70, 60) | 65 | (90, 60) | 75 |
| (70, 70) | 70 | (90, 70) | 80 |
| (70, 80) | 75 | (90, 80) | 85 |
| (70, 90) | 80 | (90, 90) | 90 |
The mean of all 16 sample means is exactly 75 — equal to the population mean μ. The possible values (60 to 90) are more concentrated around the center than the original population values, and the distribution of x̄ is already starting to look symmetric. With larger samples, this convergence to a bell shape is even stronger — that is the Central Limit Theorem in action.
🔑 Key Takeaways
The most important ideas to carry into every sampling distribution problem.
The sampling distribution is not the population distribution. It is the distribution of a statistic, not of individual data values.
The mean of the sampling distribution equals μ. Sample means are unbiased estimators of the population mean.
Standard error = σ/√n. Larger samples produce narrower sampling distributions — meaning more precise estimates.
The Central Limit Theorem is why normal-based inference works. Even non-normal populations produce a roughly normal sampling distribution when n ≥ 30.
Sample proportion: p̂ = x/n. Where x is the number of successes and n is the sample size.
When σ is unknown and n is small, use t — not Z. The t-distribution with df = n − 1 accounts for extra estimation uncertainty.
Bootstrap sampling distributions need no parametric assumptions. They construct empirical distributions from your observed data using resampling.
Types of Sampling Distributions
The three most commonly used sampling distributions each answer a different question about a different kind of data.
Sampling Distribution of the Sample Mean (x̄)
When the variable of interest is quantitative — test scores, reaction times, incomes — and you want to estimate the population mean μ, the relevant sampling distribution is that of x̄. If random samples of size n are drawn from a population with mean μ and standard deviation σ, then the sampling distribution of x̄ has:
Sampling Distribution of the Sample Proportion (p̂)
When data is categorical — yes/no, pass/fail, clicked/did not click — and you want to estimate a population proportion p, you use the sample proportion p̂ (read "p-hat"). The sample proportion is one of the most commonly used statistics in practice, appearing in opinion polls, clinical trials, quality control, and A/B testing.
The Sample Proportion Formula
p̂ = sample proportion ("p-hat")
x = number of successes in the sample
n = total sample size
p = true population proportion
Example: A survey of 500 voters finds that 215 support a ballot measure. The sample proportion is p̂ = 215/500 = 0.43, or 43%. This estimates the true population proportion p of all voters who support the measure.
How to Find the Sample Proportion: Step by Step
How to Calculate Sample Proportion (p̂)
Sample Proportion Notation
The notation p̂ (p with a "hat" symbol above it) denotes the sample proportion — a statistic calculated from data. The notation p (without a hat) denotes the unknown population proportion — the parameter we are trying to estimate. This distinction matters: p̂ is what you observe; p is what you're inferring.
Properties of the Sampling Distribution of p̂
The normal approximation conditions — np ≥ 10 and n(1−p) ≥ 10 — ensure both the number of expected successes and failures are large enough for the normal curve to be a reliable model. Some textbooks use np ≥ 5 as a threshold; the stricter rule is more conservative and widely accepted.
np ≥ 10
The expected number of successes must be at least 10. If p = 0.3 and n = 50, then np = 15 ✓.
n(1−p) ≥ 10
The expected number of failures must also be at least 10. Both conditions must hold simultaneously.
Independence
Observations are independent, or the sample is less than 10% of the population (the 10% condition for sampling without replacement).
Sampling Distribution of the Difference Between Two Means
When comparing two groups — treatment vs. control, Group A vs. Group B — the quantity of interest is x̄₁ − x̄₂. Under independence, this difference follows a sampling distribution with mean μ₁ − μ₂ and standard error √(σ₁²/n₁ + σ₂²/n₂). This is the foundation of the two-sample t-test and the two-sample z-test covered in the hypothesis testing guide at Statistics Fundamentals.
What Is Sampling Variability?
Sampling variability (also called sampling variation or random sampling variability) is the natural tendency for a statistic to differ from one random sample to the next, even when all samples are drawn from the same population. It is not measurement error or bias — it is an inherent consequence of using a subset of the population to estimate a population parameter.
Sampling Variability: A Concrete Example
Suppose the average height of all adults in a city is μ = 170 cm. You draw three independent random samples of n = 50 people each and compute the mean height in each sample. You might get: x̄₁ = 168.3 cm, x̄₂ = 171.1 cm, x̄₃ = 169.7 cm. Each sample mean is different — and none equals 170 exactly — even though the population mean is 170. That difference between sample to sample is sampling variability.
With n = 200 instead of 50, the same three samples might give: 169.8, 170.4, 169.9 — much closer to 170 in each case. Larger samples reduce sampling variability.
What Controls Sampling Variability?
Sampling variability is measured by the standard error. Three factors determine how much sampling variability exists:
Sample size (n)
The most powerful lever. Doubling n reduces SE by a factor of √2 ≈ 1.41. Quadrupling n halves SE. Larger samples produce less variability.
Population spread (σ)
A more heterogeneous population produces more variable sample statistics. If σ is large, even large samples will show more variability than a tight population.
Sampling design
Stratified sampling can reduce variability below what SRS achieves for the same n. Cluster sampling can increase it. The standard SE formula assumes simple random sampling.
The term sampling fluctuation is sometimes used interchangeably with sampling variability, particularly in older textbooks. Both refer to the same phenomenon: the chance variation in a statistic from sample to sample. See the dedicated sampling variability guide for more detail and examples.
Standard Error: Formula, Meaning & Effect of Sample Size
Standard error is the standard deviation of the sampling distribution. It measures how much the statistic fluctuates across repeated samples — not how much individual data points fluctuate within a sample. That distinction is what many students miss.
σ = population standard deviation
n = sample size
SE = spread of the sampling distribution
A concrete example shows how dramatically sample size changes precision. Suppose a population has σ = 20:
| Sample size (n) | SE = 20/√n | Interpretation |
|---|---|---|
| n = 4 | SE = 10.0 | Sample mean varies by ±10 points on average |
| n = 16 | SE = 5.0 | Precision doubles from n = 4 |
| n = 100 | SE = 2.0 | Now within ±2 points of μ on average |
| n = 400 | SE = 1.0 | Quadrupling n halves SE again |
Standard deviation (s or σ) describes spread within a dataset. Standard error (SE = σ/√n) describes spread of a statistic across samples. Reporting SE in place of SD makes results look more precise than they are — a frequent error in published research. The two quantities shrink at different rates: SE shrinks with 1/√n; SD stays roughly constant regardless of n.
Finite Population Correction Factor
The formula SE = σ/√n assumes the population is either infinite or that sampling occurs with replacement. When sampling without replacement from a finite population of size N, and the sample makes up more than about 5% of that population (n/N > 0.05), the standard SE formula overstates true variability. Apply the finite population correction (FPC):
N = population size
n = sample size
√((N−n)/(N−1)) = FPC factor (always < 1)
Example: A company has 200 employees (N = 200). You survey 40 of them (n = 40). Since 40/200 = 20% > 5%, the FPC applies. With σ = 10: unadjusted SE = 10/√40 = 1.58. FPC factor = √((200−40)/(200−1)) = √(160/199) = 0.897. Corrected SE = 1.58 × 0.897 = 1.42. The correction reduces SE by about 10% in this case. The NIST/SEMATECH e-Handbook of Statistical Methods provides a formal derivation of this correction and its assumptions for finite population inference.
The Central Limit Theorem
The Central Limit Theorem (CLT) is the reason normal-based inference works on data that are decidedly not normal. It states that as sample size n increases, the sampling distribution of the sample mean approaches a normal distribution — regardless of the shape of the population distribution, provided the population has a finite mean and finite variance.
If X₁, X₂, …, Xₙ are independent, identically distributed random variables with mean μ and variance σ², then the sampling distribution of x̄ = (X₁ + X₂ + … + Xₙ)/n converges to N(μ, σ²/n) as n → ∞. In practice, n ≥ 30 is a common guideline for the approximation to be reliable — a rule of thumb widely cited in statistics textbooks and referenced in NIST statistical methods documentation, though the exact n required depends on population skewness.
Three Conditions for the CLT to Apply
Independence
The sampled values must be independent. For sampling without replacement, independence holds when the sample is less than 10% of the population (the 10% condition).
Sample Size (n ≥ 30)
The general guideline is n ≥ 30. For highly skewed populations, a larger n may be needed. For populations already close to normal, n can be smaller — even n = 10 may suffice.
Finite Variance
The population must have a finite mean and finite variance. Heavy-tailed distributions like the Cauchy distribution violate this and the CLT does not apply to them.
How Skewness Affects the Required Sample Size
The n ≥ 30 rule is a guideline, not a law. A roughly symmetric population achieves a near-normal sampling distribution at n = 10 or 15. A right-skewed income distribution or an exponential distribution may need n = 50 or more for the approximation to be accurate. The more extreme the skewness, the more samples you need to average before the CLT smooths out the population's shape.
The Central Limit Theorem (Wikipedia) provides a rigorous treatment of the convergence conditions, including Lindeberg's more general version that relaxes the identical distribution requirement.
Real-World Example
Election Polling and the CLT
National poll samples are rarely drawn from normally distributed populations — voter preferences are binary (support or oppose). But because samples of n = 800 to 1,500 are used, the CLT guarantees the sampling distribution of the sample proportion is approximately normal. That is why every poll reports a margin of error: it is approximately 2 × SE = 2 × √(p̂(1−p̂)/n). For n = 1,000 and p̂ = 0.50, the margin is 2 × √(0.25/1000) ≈ ±3.2 percentage points — a number you will see cited in virtually every major media poll.
When σ Is Unknown: The t-Distribution
The Z-based sampling distribution (x̄ ~ N(μ, σ/√n)) assumes σ is known. In practice, σ is almost never known — you estimate it from the sample using s. That estimation introduces additional uncertainty, and the t-distribution accounts for it.
When σ is unknown and either the population is approximately normal or n is small (typically n < 30), the standardized sample mean follows a t-distribution rather than a Z-distribution:
x̄ = sample mean
μ = hypothesized population mean
s = sample standard deviation
n = sample size
df = n − 1 = degrees of freedom
t-Distribution vs. Z-Distribution: When to Use Each
| Situation | Use Z | Use t |
|---|---|---|
| σ known | Yes | No |
| σ unknown, n ≥ 30 | Acceptable (t ≈ Z) | Preferred (technically correct) |
| σ unknown, n < 30, population normal | No | Yes (df = n − 1) |
| σ unknown, n < 30, population non-normal | No | Problematic — consider bootstrap |
The t-distribution is wider and heavier-tailed than Z when df is small. As df → ∞ (i.e., as n → ∞), the t-distribution converges to the standard normal. At df = 30, t and Z are already very close. Critical values for the t-distribution appear in the t-distribution table — look up the correct df and significance level before computing a test or interval.
Step-by-Step Worked Examples
Work through each example in order: identify parameters, compute the standard error, standardize, and look up the probability. That four-step structure works for every sampling distribution problem.
Exam scores at a university have μ = 72 and σ = 15. A random sample of n = 36 students is selected. What is the probability that the sample mean exceeds 76?
Identify parameters: μ = 72, σ = 15, n = 36. CLT check: n = 36 ≥ 30 ✓. Sampling distribution: x̄ ~ N(72, 15/√36) = N(72, 2.5).
Compute SE: SE = σ/√n = 15/√36 = 15/6 = 2.5
Standardize: Z = (x̄ − μ) / SE = (76 − 72) / 2.5 = 4 / 2.5 = 1.60
Find probability: P(x̄ > 76) = P(Z > 1.60) = 1 − 0.9452 = 0.0548
Answer: There is a 5.48% probability that a sample of 36 students has a mean exam score above 76. Use the Z-table to verify P(Z ≤ 1.60) = 0.9452.
A product has a 30% defect rate (p = 0.30). A quality inspector samples n = 100 items. What is the probability that the sample proportion of defective items is less than 25%?
Find the sample proportion formula values: p = 0.30, n = 100. Conditions: np = 30 ≥ 10 ✓, n(1−p) = 70 ≥ 10 ✓. Sampling distribution of p̂ is approximately normal with mean p = 0.30.
Compute SE of proportion: SE = √(p(1−p)/n) = √(0.30 × 0.70 / 100) = √(0.0021) = 0.0458
Standardize: Z = (p̂ − p) / SE = (0.25 − 0.30) / 0.0458 = −0.05 / 0.0458 = −1.09
Find probability: P(p̂ < 0.25) = P(Z < −1.09) = 0.1379
Answer: There is a 13.8% chance the inspector observes fewer than 25% defective items in a sample of 100, even though the true defect rate is 30%. This is sampling variability at work — the sample proportion p̂ will differ from the true p by chance.
A lab measures reaction times for n = 16 participants. The sample gives x̄ = 248 ms and s = 40 ms. The population mean is hypothesized to be 260 ms. Does the sample provide evidence that the true mean differs from 260 ms (two-tailed, α = 0.05)?
Identify parameters: x̄ = 248, μ₀ = 260, s = 40, n = 16. Since σ is unknown and n < 30, use t with df = 16 − 1 = 15.
Compute SE: SE = s/√n = 40/√16 = 40/4 = 10 ms
Compute t-statistic: t = (248 − 260) / 10 = −12/10 = −1.20
Compare to critical value: For two-tailed test with df = 15 and α = 0.05, critical t = ±2.131 (from the t-table). Since |−1.20| = 1.20 < 2.131, fail to reject H₀.
Answer: The sample does not provide sufficient evidence (at α = 0.05) that the true mean reaction time differs from 260 ms. The observed difference of 12 ms is within normal sampling variability for n = 16.
In a clinical trial, 84 out of 350 patients in the treatment group experienced the primary endpoint. What is the sample proportion, and does the normal approximation apply?
Identify x and n: x = 84 (successes), n = 350 (total sample size).
Calculate p̂ = x/n: p̂ = 84/350 = 0.24 (24% of patients reached the endpoint).
Check normal approximation: np̂ = 350 × 0.24 = 84 ≥ 10 ✓. n(1−p̂) = 350 × 0.76 = 266 ≥ 10 ✓. Normal approximation holds.
Compute SE for further inference: SE = √(p̂(1−p̂)/n) = √(0.24 × 0.76 / 350) = √(0.000521) = 0.0228. A 95% confidence interval for the true proportion p is 0.24 ± 1.96 × 0.0228 = (0.195, 0.285).
Answer: The sample proportion is p̂ = 0.24 (24%). With n = 350, both normal approximation conditions are satisfied. The 95% confidence interval for the true response rate is approximately 19.5% to 28.5%.
Bootstrap Sampling Distributions
Classical sampling distribution theory requires assumptions: normality of the population, or n large enough for the CLT. Bootstrap resampling sidesteps these requirements by constructing an empirical sampling distribution directly from your observed data.
How Bootstrapping Works
- Start with your original sample of n observations.
- Draw a new sample of size n with replacement from the original — this is one bootstrap sample.
- Compute the statistic of interest (mean, median, proportion, correlation, etc.) on the bootstrap sample.
- Repeat steps 2–3 a large number of times — typically B = 1,000 to 10,000.
- Plot the B bootstrap statistics. The resulting histogram is the bootstrap sampling distribution.
- Use the 2.5th and 97.5th percentiles of this distribution as a 95% bootstrap confidence interval.
Bootstrap distributions work well when the population is non-normal and n is too small for the CLT, when you are estimating a complex statistic like a correlation or ratio, or when no theoretical sampling distribution formula exists for your statistic. The bootstrap method was introduced by Bradley Efron in 1979 and is now a standard tool in computational statistics and machine learning. In Python, scipy.stats.bootstrap implements non-parametric bootstrap with a default of n_resamples = 9999. See the bootstrap sampling guide for implementation examples.
How Sampling Method Affects the Distribution
The standard error formula SE = σ/√n assumes simple random sampling (SRS) — every possible sample of size n has an equal chance of selection. Other sampling designs change the standard error, sometimes substantially.
Simple Random Sampling (SRS)
Every member of the population has an equal probability of selection. SE = σ/√n applies directly. Independence holds (or approximately holds via the 10% condition).
Stratified Sampling
The population is divided into strata; separate random samples are drawn from each. Within-stratum homogeneity reduces the effective SE — often producing a narrower sampling distribution than SRS of the same n. The design effect (DEFF) quantifies the gain.
Cluster Sampling
Groups (clusters) are randomly selected, then all members within a cluster are surveyed. Observations within the same cluster tend to be correlated, which inflates the effective SE relative to SRS. The intraclass correlation coefficient (ICC) captures this inflation.
Real-World Applications
Sampling distributions are not abstract theory. They drive decisions in every field that draws inferences from data.
Political Polling
Polls compute a sample proportion p̂ and report a margin of error — which is precisely 2 × SE of p̂. A poll of n = 1,000 with p̂ = 0.50 has a margin of ±3.2 percentage points at 95% confidence.
Clinical Trials
The sampling distribution of the difference between treatment and control group proportions or means determines whether observed differences exceed what sampling variability alone could produce. Every drug approval relies on this logic.
Quality Control
Control charts plot sample means over time and use the sampling distribution (specifically, 3 × SE control limits) to flag when a manufacturing process has shifted out of statistical control.
A/B Testing
In digital product experiments, the sampling distribution of the difference in conversion rates (difference of two sample proportions p̂_A − p̂_B) determines the minimum detectable effect and required sample size for a valid test.
Financial Risk
Portfolio managers use the sampling distribution of average returns across historical periods to construct confidence intervals for expected future performance — a direct application of the CLT to asset return data.
Sampling Distributions and Inferential Statistics
Every procedure in inferential statistics — confidence intervals, Z-tests, t-tests, proportion tests — is built directly on the sampling distribution of some statistic. Understanding this connection removes the mystery from these procedures.
Confidence Intervals
A 95% confidence interval for the population mean is: x̄ ± z* × SE, where z* = 1.96 for 95% confidence. The width of the interval is 2 × 1.96 × SE. Narrower sampling distributions (larger n, smaller σ) produce narrower intervals — which is why increasing sample size reduces sampling variability and improves estimation precision. See the hypothesis testing guide on Statistics Fundamentals for confidence interval construction with t-critical values.
Hypothesis Testing
A hypothesis test computes the probability of observing a test statistic as extreme as the one obtained, assuming H₀ is true. That probability — the p-value — is an area under the sampling distribution curve. Reject H₀ when the p-value falls below the chosen significance level α. The normal distribution guide explains how to read Z-scores from these distributions, and the Z-table and t-table provide the critical values.
Common Mistakes and Misconceptions
Treating the sampling distribution as the sample distribution
The sampling distribution is the distribution of a statistic across repeated samples — it is not the distribution of data values within a single sample. Using the sample's standard deviation where the standard error is required produces completely wrong probability calculations.
Treating n ≥ 30 as a hard threshold
The n ≥ 30 guideline is a rule of thumb, not a mathematical threshold. A strongly skewed or heavy-tailed population may need n = 100 or more. A near-normal population may be fine at n = 10. Checking the shape of your data matters more than hitting a magic number.
Using Z when t is required
When σ is unknown and n is small, plugging in s and using a Z-critical value underestimates the true uncertainty. The t-distribution is wider, which correctly reflects the fact that using an estimated standard deviation introduces additional error.
Assuming the population must be normally distributed
The CLT does not require a normal population. It only requires that the population has a finite mean and variance, and that n is large enough. The sampling distribution of x̄ becomes normal with sufficient n, regardless of the population's shape.
Confusing sampling variability with measurement error
Sampling variability is not a mistake or flaw — it is the expected, predictable fluctuation in a statistic from sample to sample. Measurement error refers to inaccuracies in how individual values are recorded. Both affect estimates, but they have different sources and are addressed differently.
Forgetting the finite population correction when sampling large fractions
The standard formula SE = σ/√n assumes sampling from a large population. When the sample exceeds 5–10% of the population, ignoring the FPC overstates the standard error and makes confidence intervals unnecessarily wide.
Quick Reference: Sampling Distributions Summary
| Statistic | Formula | Mean of sampling dist. | Standard Error (SE) | Shape (large n) | Use t when |
|---|---|---|---|---|---|
| Sample mean (x̄) | x̄ = Σx/n | μ | σ/√n | N(μ, σ²/n) | σ unknown, n small |
| Sample proportion (p̂) | p̂ = x/n | p | √(p(1−p)/n) | Normal if np,n(1−p)≥10 | Rarely (use Z for proportions) |
| Difference x̄₁ − x̄₂ | — | μ₁ − μ₂ | √(σ₁²/n₁ + σ₂²/n₂) | Normal (by CLT) | σ₁, σ₂ unknown |
| With FPC | — | μ | (σ/√n) × √((N−n)/(N−1)) | Normal | Same as x̄ rules |
| Bootstrap | — | Empirical | SD of bootstrap statistics | Empirical (no assumption) | Not applicable |
Related Topics on Statistics Fundamentals
Sampling distributions sit at the center of inferential statistics. Every topic below connects directly to concepts covered on this page. See also the dedicated sub-guides: sample proportions, sampling variability, Central Limit Theorem, bootstrap sampling, and standard error.
Normal Distribution
- The target shape of sampling distributions
- Governs Z-score calculations
- Defines confidence interval critical values
- Connected via CLT
Hypothesis Testing
- Uses sampling distributions for p-values
- Z-tests and t-tests are direct applications
- Type I/II errors defined in terms of sampling dist.
- Power depends on SE
Binomial Distribution
- Sampling distribution of p̂ derives from binomial
- Normal approximation via CLT
- np ≥ 10 condition parallels CLT requirement
- Foundation for proportion tests
t, Chi-Square & F Distributions
- All are sampling distributions of specific statistics
- t = ratio involving normal and chi-square
- F = ratio of two chi-square variables
- Used in ANOVA and regression inference
Read More Articles
Normal Distribution
Understand the bell curve that sampling distributions converge toward — properties, Z-scores, and the empirical rule.
Read More →Hypothesis Testing
See how sampling distributions drive Z-tests, t-tests, and proportion tests in practice.
Read More →Binomial Distribution
The distribution behind the sampling distribution of proportions — with full formula walkthrough and examples.
Read More →Frequently Asked Questions
Imagine taking many random samples of the same size from a population and computing the mean of each one. The distribution of all those sample means is the sampling distribution of the mean. It tells you how much sample means vary from sample to sample — and because that variation (sampling variability) is predictable and quantifiable, you can use it to make probability statements about where the true population mean lies.
The sample proportion formula is p̂ = x/n, where x is the number of successes (individuals with the characteristic of interest) in the sample, and n is the total sample size. For example, if 90 out of 300 customers made a purchase, then p̂ = 90/300 = 0.30 (30%). The sample proportion p̂ is used to estimate the unknown population proportion p. The sampling distribution of p̂ is approximately normal when both np ≥ 10 and n(1−p) ≥ 10.
Sampling variability is the expected, natural fluctuation in a statistic — such as a sample mean or sample proportion — from one random sample to the next, even when all samples come from the same population. It is not an error; it is a fundamental property of sampling. The standard error (SE = σ/√n) quantifies sampling variability: the smaller the SE, the less variability in the statistic across samples. Increasing the sample size n is the primary way to reduce sampling variability.
A sample distribution is the distribution of the data values in one sample — it approximates the population distribution and has standard deviation s. A sampling distribution is the distribution of a statistic (like the sample mean or sample proportion) across all possible samples of a given size — it is much narrower than the population distribution and has standard deviation SE = σ/√n. These two quantities serve completely different purposes and should never be substituted for each other.
The standard error of the sample mean is SE = σ/√n, where σ is the population standard deviation and n is the sample size. If σ is unknown, replace it with the sample standard deviation s. Standard error decreases as n increases — quadrupling the sample size halves the standard error. For proportions, SE = √(p(1−p)/n). When sampling more than 5% of a finite population, apply the finite population correction: multiply SE by √((N−n)/(N−1)).
No. The Central Limit Theorem applies to any population with a finite mean and variance, regardless of its shape. For a roughly symmetric population, the sampling distribution becomes approximately normal at n = 15 or less. For a heavily skewed population, n = 50 or more may be needed. The population itself does not need to be normal — only the sampling distribution of the mean needs to be approximately normal, and the CLT guarantees that happens with sufficient n.
Use the t-distribution when the population standard deviation σ is unknown and you substitute the sample standard deviation s. With small samples (n < 30), this substitution introduces meaningful additional uncertainty that the t-distribution captures through its heavier tails. Specifically, use t when: (1) σ is unknown, (2) the population is approximately normal or n is large enough for CLT, and (3) you need the degrees of freedom to be df = n − 1. When n ≥ 30, Z and t give nearly identical answers.
When a sample is drawn without replacement from a finite population, and the sample size n exceeds about 5% of the population size N, the standard error formula overestimates the true variability. The finite population correction (FPC) adjusts for this: corrected SE = (σ/√n) × √((N−n)/(N−1)). The FPC factor is always less than 1, so it reduces the standard error. When n/N is small — as in most large-scale surveys — the FPC is negligible and can be ignored.
Bootstrap resampling treats your observed sample as a stand-in for the population. You draw thousands of new samples of size n from your original sample, with replacement, and compute the statistic of interest on each bootstrap sample. The resulting collection of bootstrap statistics forms the bootstrap sampling distribution. Its spread estimates the standard error; its 2.5th and 97.5th percentiles give a 95% bootstrap confidence interval. No assumptions about population shape are needed, making bootstrap especially useful for small samples or complex statistics.
In an A/B test, you observe conversion rates p̂_A and p̂_B from two groups of users. The quantity of interest is p̂_A − p̂_B (the difference between two sample proportions). Under the null hypothesis that the true rates are equal, the sampling distribution of this difference is approximately normal with a calculable standard error. The test computes a Z-score for the observed difference and checks whether it falls in the rejection region. The required sample size per group is determined by specifying a minimum detectable effect, significance level α, and desired power (1 − β) — all quantities that depend on the sampling distribution's shape and spread.