Random Variables in Statistics — Everything You Need to Know

What Is a Random Variable?

A random variable is a function that maps each outcome of a random experiment to a real number. You write it as a capital letter — X, Y, or Z — to signal that its value is not fixed until the experiment runs.

Roll a standard die. Call the result X. Before you roll, X could be 1, 2, 3, 4, 5, or 6. After you roll, X becomes one specific number. That uncertainty before the roll, and the mapping of outcomes to numbers, is what makes X a random variable.

Formally, if Ω is the sample space of all possible outcomes, a random variable X is a function X: Ω → ℝ. Each outcome ω maps to a real number X(ω). You use lowercase x to denote a specific observed value: P(X = x) is the probability that the random variable X takes the value x.

Notation and Sample Space

Getting the notation right prevents a lot of confusion later. Here is the standard convention used across textbooks and software.

The sample space Ω for a coin toss is {H, T}. If X = 1 for heads and X = 0 for tails, then X maps Ω → {0, 1}. That mapping is the random variable. The domain is the sample space. The range is a set of real numbers.

Types of Random Variables: Discrete vs Continuous

Every random variable falls into one of two main categories. The distinction determines which formulas you use and which distributions apply.

Discrete Random Variables

A discrete random variable takes a countable number of distinct values. Countable means you can list them out: 0, 1, 2, 3, and so on. There may be infinitely many possible values, but they are still countable in the mathematical sense.

Examples: number of heads in 10 coin tosses, number of customers entering a shop per hour, number of defective items in a batch of 50.

Continuous Random Variables

A continuous random variable can take any value within an interval. Between any two values there are infinitely many possibilities. You cannot list them.

Examples: the exact height of a randomly selected student, the time until a light bulb burns out, the temperature at noon tomorrow.

Probability Distributions for Discrete Variables

Probability Mass Function (PMF)

The PMF gives the probability that X equals each specific value. It satisfies two conditions: P(X = x) ≥ 0 for all x, and the sum of all probabilities equals 1.

For a fair die, the PMF is:

Each value has probability 1/6. All six probabilities sum to 1. That is a valid PMF.

Cumulative Distribution Function (CDF)

The CDF gives F(x) = P(X ≤ x). For the die example, F(3) = P(X ≤ 3) = 3/6 = 0.5. The CDF always starts at 0, ends at 1, and never decreases.

Named Discrete Distributions

Probability Distributions for Continuous Variables

Probability Density Function (PDF)

For a continuous random variable, the PDF f(x) satisfies f(x) ≥ 0 and the total area under the curve equals 1. The probability that X falls in the interval [a, b] is the area under f(x) from a to b.

One key fact trips people up: for any single exact value, P(X = x) = 0. This is not an error. With infinitely many possible values, no single point can carry positive probability. You ask instead: what is P(2.0 ≤ X ≤ 2.5)?

Named Continuous Distributions

Expected Value (Mean) of a Random Variable

The expected value E[X] is the long-run average you would get if you repeated the random experiment many times. Think of it as the center of gravity of the distribution.

Formula for Discrete Variables

E[X] = Σ x · P(X = x)

Multiply each value by its probability, then add everything up.

Formula for Continuous Variables

E[X] = ∫ x · f(x) dx, integrated over all possible values of x.

Key Properties of Expected Value

• E[aX + b] = a · E[X] + b — scale and shift work through linearly
• E[X + Y] = E[X] + E[Y] — this holds whether X and Y are independent or not
• E[constant] = that constant
• E[g(X)] ≠ g(E[X]) in general — this is Jensen's inequality territory

Variance and Standard Deviation

Expected value tells you where the distribution sits. Variance tells you how spread out the values are around that center.

Variance Formula

Var(X) = E[(X − μ)²] = E[X²] − (E[X])²

The second form — E[X²] minus the square of E[X] — is usually faster to calculate by hand.

Standard deviation: σ = √Var(X). Because standard deviation is in the same units as X, it is easier to interpret than variance.

Key Properties of Variance

• Var(aX + b) = a² · Var(X) — adding a constant does not change spread; multiplying by a scales variance by a²
• Var(X + Y) = Var(X) + Var(Y) when X and Y are independent
• Variance is always ≥ 0

Transformations of Random Variables

You often need to work with a function of a random variable rather than the variable itself. If X has a known distribution, what does Y = g(X) look like?

Linear Transformations

For Y = aX + b:

• E[Y] = a · E[X] + b
• Var(Y) = a² · Var(X)
• σ_Y = |a| · σ_X

Standardisation

Given X with mean μ and standard deviation σ, the standardised variable is:

Z = (X − μ) / σ

Z always has E[Z] = 0 and Var(Z) = 1. When X is normal, Z follows the standard normal distribution N(0, 1). This is the basis for z-scores and normal distribution tables.

Sum of Random Variables

Many real problems involve adding or combining random variables. Two rules carry the work.

• E[X + Y] = E[X] + E[Y] — always, regardless of independence
• Var(X + Y) = Var(X) + Var(Y) + 2·Cov(X, Y)

When X and Y are independent, Cov(X, Y) = 0, so Var(X + Y) = Var(X) + Var(Y).

Covariance

Covariance measures how two variables move together. Cov(X, Y) = E[XY] − E[X] · E[Y].

Positive covariance: X and Y tend to be large together. Negative: when one is high, the other is often low. Covariance = 0 means no linear relationship, though the two variables may still be related in nonlinear ways.

Real-World Examples of Random Variables

Common Mistakes and Misconceptions

These are the errors that show up most often in homework, exams, and data work.

Random Variables vs Other Statistical Terms

FAQs