Comparing Chebyshev’s Inequality with Actual Distribution Properties

Chebyshev’s Inequality Made Simple (With Real Examples)

📚 Table of Contents

• What is Chebyshev’s Inequality?
• Core Intuition
• Gaussian Example (Heights)
• Non-Gaussian Example (Income)
• Comparison Table
• Code Example
• CLI Output
• Key Takeaways

---

📖 What is Chebyshev’s Inequality?

Chebyshev’s inequality tells us how far values can be from the mean — for any dataset.

💡 It works even if you don’t know the distribution shape.

Formula:

P(|X - μ| ≥ kσ) ≤ 1 / k²

Meaning:

• k = number of standard deviations
• It gives a maximum possible percentage outside that range

---

🧠 Core Intuition

Chebyshev is a safety guarantee.

It says:

“No matter what your data looks like, at least some minimum portion stays close to the mean.”

But it does NOT tell the exact distribution — only a safe upper limit.

---

📊 Gaussian Example (Heights)

Mean = 65 inches Standard deviation = 3 inches

Chebyshev Prediction

• k = 2 → ≤ 25% outside
• k = 3 → ≤ 11.1% outside

Actual Reality (Normal Distribution)

• 2σ → ~95% inside
• 3σ → ~99.7% inside

💡 Chebyshev is very conservative here (too loose).

---

💰 Non-Gaussian Example (Income)

Mean = $50,000 Standard deviation = $20,000 Distribution = Right-skewed

Chebyshev Prediction

• k = 2 → ≤ 25% outside
• k = 3 → ≤ 11.1% outside

Reality

Income data is skewed:

• More extreme values on the high side
• Not symmetric like Gaussian

💡 Important: Actual values are usually lower than Chebyshev bound, but unevenly distributed (more on one side).

---

📊 Comparison Table

Feature	Gaussian	Non-Gaussian
Shape	Symmetric	Skewed
Accuracy of Chebyshev	Loose	Still safe but less informative
Extreme Values	Rare	More common
Best Use	Backup estimate	Safety guarantee

---

💻 Code Example

import numpy as np

data = np.random.normal(65, 3, 1000)

mean = np.mean(data)
std = np.std(data)

k = 2

outside = np.sum(np.abs(data - mean) >= k * std)
prob = outside / len(data)

print(prob)

---

🖥 CLI Output

0.048

≈ 4.8% outside 2σ → matches Gaussian (~5%)

---

🎯 Key Takeaways

✔ Chebyshev works for ANY dataset ✔ It gives a maximum bound, not exact value ✔ Very useful when distribution is unknown ✔ Less useful when distribution is known (like normal) ✔ Always safe, but often too conservative

---

📚 Related Articles

• PDF vs CDF Explained
• Silhouette Score
• Softmax vs Probability