How to Calculate Expectation and Variance of Random Variables

If you’ve ever dipped your toes into statistics or probability, you’ve likely come across the terms **expectation** and **variance**. These concepts might sound complex, but in reality, they’re fundamental ideas that help describe the behavior of random events in everyday life. Let’s break them down in a way that’s easy to understand.

### What is a Random Variable?

Before we dive into expectation and variance, we need to understand what a **random variable** is. Simply put, a random variable is a way to assign numerical values to outcomes of random events. For example:

- If you roll a six-sided die, the result (1, 2, 3, 4, 5, or 6) is a random variable.

- If you flip a coin and call heads as 1 and tails as 0, the outcome is a random variable.

Random variables can either be **discrete** (like the die roll, where you have specific outcomes) or **continuous** (like measuring the height of people, which can take any value within a range).

### Expectation: The Long-Run Average

The **expectation** (or **expected value**) of a random variable is a concept that helps us understand the average outcome if we repeated the random process over and over. It's like asking, "What result can I expect on average?"

#### Example: Rolling a Die

Let’s say you roll a fair six-sided die. Each number (1 to 6) has an equal chance of showing up. The expected value tells us what we should expect, on average, if we rolled the die many times.

To calculate the expectation:

1. Multiply each outcome by its probability.

2. Add up all those values.

For a six-sided die, the possible outcomes are 1, 2, 3, 4, 5, and 6, and each has a probability of 1/6 (since the die is fair). So, the expected value of the die roll is:

Expectation (E) = (1 × 1/6) + (2 × 1/6) + (3 × 1/6) + (4 × 1/6) + (5 × 1/6) + (6 × 1/6)

Simplifying that:

E = (1 + 2 + 3 + 4 + 5 + 6) × 1/6  

E = 21 × 1/6 = 3.5

So, the expected value is 3.5. Of course, you can never actually roll a 3.5 on a die, but this is the **average** outcome if you rolled the die many times.

### Variance: How Much Do the Outcomes Vary?

While expectation gives us the average, **variance** tells us how much the outcomes fluctuate around that average. In other words, it measures how “spread out” the possible outcomes are from the expected value.

If the outcomes are close to the expected value, the variance will be small. If the outcomes are very different from the expected value, the variance will be larger.

#### Example: Die Roll Variance

To calculate variance, we follow these steps:

1. Find the difference between each outcome and the expected value (3.5 in our case).

2. Square that difference (this ensures that both positive and negative deviations are treated equally).

3. Multiply each squared difference by the probability of the outcome.

4. Sum them all up.

For the die roll, this looks like:

Variance = [(1 - 3.5)² × 1/6] + [(2 - 3.5)² × 1/6] + [(3 - 3.5)² × 1/6] + [(4 - 3.5)² × 1/6] + [(5 - 3.5)² × 1/6] + [(6 - 3.5)² × 1/6]

Breaking it down:

Variance = [(2.5)² × 1/6] + [(1.5)² × 1/6] + [(0.5)² × 1/6] + [(-0.5)² × 1/6] + [(-1.5)² × 1/6] + [(-2.5)² × 1/6]

Variance = (6.25 × 1/6) + (2.25 × 1/6) + (0.25 × 1/6) + (0.25 × 1/6) + (2.25 × 1/6) + (6.25 × 1/6)

Variance = 1.04 + 0.38 + 0.04 + 0.04 + 0.38 + 1.04 = 2.92

So, the variance for a fair six-sided die is approximately 2.92.

### Why Expectation and Variance Matter

So why are these ideas important? Expectation and variance give us two key pieces of information:

1. **Expectation** tells us the central or average value we can anticipate.

2. **Variance** helps us understand how reliable that expectation is. A low variance means most outcomes are close to the expectation, while a high variance means the outcomes are more spread out and less predictable.

For example, in gambling or investments, knowing the expectation helps you gauge whether a bet or decision is worth making. Knowing the variance helps you understand the risk involved. If an investment has a high expected return but also a high variance, there’s a lot of risk that things might not go as planned.

### Conclusion

In simple terms:

- **Expectation** is what you expect on average.

- **Variance** tells you how much the outcomes vary from that average.

These two concepts are the building blocks of probability and statistics, and they help us make informed decisions in uncertain situations. Whether you’re rolling dice, flipping coins, or evaluating investment opportunities, understanding expectation and variance gives you a clearer picture of what to expect and how risky it might be.