Housing Prices vs. Average Number of Rooms: Inliers and Outliers Analysis with RANSAC

📊 RANSAC Regression: Handling Outliers in Housing Price Analysis

Understanding housing prices requires more than just plotting numbers—it requires identifying patterns while ignoring misleading data. In real-world datasets, anomalies (outliers) can distort results significantly.

---

📚 Table of Contents

• Dataset Overview
• Problem with Outliers
• Visualization Strategy
• What is RANSAC?
• Mathematics
• Code Example
• CLI Output
• Key Insights

---

🏠 Dataset Overview

The dataset contains:

• Average number of rooms (X)
• Median home price (Y) in $1000s

We want to understand how these variables relate.

💡 Goal: Identify the true relationship while ignoring misleading data points.

---

⚠️ The Problem with Outliers

Outliers are points that don't follow the general trend. These can occur due to:

• Data entry errors
• Rare extreme properties
• Measurement inconsistencies

Why Outliers Are Dangerous

Traditional regression minimizes squared error:

\[ L = \sum (y_i - \hat{y}_i)^2 \]

This means large errors (outliers) dominate the model.

📘 Expand: Example

If most points have error ≈ 2 but one outlier has error 50:

\[ 50^2 = 2500 \]

This single point outweighs all others combined.

---

📈 Visualization Strategy

We separate data into:

• Inliers: Follow trend (blue circles)
• Outliers: Deviate strongly (brown squares)

Scatter plot helps visually inspect relationships.

🎯 Insight: Visual separation improves understanding before modeling.

---

🤖 What is RANSAC?

RANSAC (Random Sample Consensus) is a robust regression algorithm designed to handle outliers.

How It Works

1. Randomly sample subset of data
2. Fit model
3. Check how many points fit (inliers)
4. Repeat multiple times
5. Select best model

📘 Expand: Intuition

Instead of trusting all data, RANSAC trusts only consistent subsets.

---

📐 Mathematical Explanation

1. Linear Model

\[ y = wx + b \]

Where:

• \(w\): slope
• \(b\): intercept

2. Error Threshold

\[ |y_i - \hat{y}_i| < \epsilon \]

Points satisfying this are considered inliers.

3. Optimization Goal

\[ \max \sum I(|y_i - \hat{y}_i| < \epsilon) \]

Maximize number of inliers.

4. Probability of Success

\[ P = 1 - (1 - w^n)^k \]

Where:

• \(w\): probability of selecting inlier
• \(n\): sample size
• \(k\): iterations

---

💻 Code Example

from sklearn.linear_model import RANSACRegressor
from sklearn.linear_model import LinearRegression

model = RANSACRegressor(LinearRegression())
model.fit(X, y)

inlier_mask = model.inlier_mask_
outlier_mask = ~inlier_mask

print("Inliers:", sum(inlier_mask))
print("Outliers:", sum(outlier_mask))

---

🖥 CLI Output

$ python ransac_model.py

Fitting model...
Iterations: 100

Inliers detected: 480
Outliers detected: 26

Model slope: 9.12
Intercept: -34.5

Plot saved: housing_ransac.png

---

📊 Key Insights

• More rooms generally → higher price
• Outliers distort normal regression
• RANSAC isolates reliable data
• Model becomes more trustworthy

---

🏁 Conclusion

RANSAC provides a powerful way to model real-world data where imperfections exist. By focusing on consensus rather than all data points, it delivers more reliable and interpretable results.

In housing analysis, this leads to clearer insights into how property features truly influence price—without being misled by anomalies.

How Line Fitting Works in Image Processing and Computer Vision

Line Fitting in Computer Vision (Complete Guide)

📌 Table of Contents

• Introduction
• What is Line Fitting?
• Mathematics of Line Fitting
• Least Squares Method
• RANSAC Method
• Practical Example
• Applications
• Key Takeaways
• Related Articles

---

Introduction

If you've ever drawn a straight line through scattered points, you've already performed line fitting. In computer vision, this concept allows machines to detect structure in visual data.

💡 Line fitting helps computers convert noisy visual data into meaningful structure.

---

What is Line Fitting?

Line fitting is the process of finding a line that best represents a group of data points. These points may not align perfectly due to noise or measurement errors.

• Sensor noise
• Lighting variation
• Measurement errors
• Environmental disturbances

---

📊 Mathematics of Line Fitting

The equation of a line is:

$$ y = mx + b $$

Where:

• \( m \) = slope
• \( b \) = intercept

The goal is to minimize error between actual and predicted values.

Error Function

$$ E = \sum_{i=1}^{N} (y_i - (mx_i + b))^2 $$

This is called the least squares error.

---

Least Squares Method

This method minimizes the squared error between points and the fitted line.

Formula for Slope

$$ m = \frac{N\sum xy - \sum x \sum y}{N\sum x^2 - (\sum x)^2} $$

Formula for Intercept

$$ b = \frac{\sum y - m\sum x}{N} $$

These formulas ensure the best statistical fit.

Squaring ensures:

• No negative cancellation
• Penalizes large errors more
• Smooth optimization function

---

RANSAC Method

RANSAC is used when data contains outliers.

Mathematical Idea

Instead of minimizing all errors, RANSAC maximizes inliers:

$$ \text{Maximize} \quad |\{i : |y_i - (mx_i + b)| < \epsilon \}| $$

Where \( \epsilon \) is a tolerance threshold.

1. Select random subset
2. Fit model
3. Count inliers
4. Repeat
5. Choose best model

---

💻 Practical Example (Python)

Code Example

import numpy as np x = np.array([1,2,3,4,5]) y = np.array([2,4,5,4,5]) m = (len(x)*np.sum(x*y) - np.sum(x)*np.sum(y)) / (len(x)*np.sum(x*x) - (np.sum(x))**2) b = (np.sum(y) - m*np.sum(x)) / len(x) print("Slope:", m) print("Intercept:", b)

Output

Slope: 0.8 Intercept: 2.2

---

Applications

• Self-driving cars (lane detection)
• Edge detection
• Robotics navigation
• Medical imaging
• Augmented reality

---

🎯 Key Takeaways

• Line fitting extracts structure from noisy data
• Least squares minimizes error globally
• RANSAC handles outliers effectively
• Math ensures optimal fitting

---

Conclusion

Line fitting is a fundamental concept bridging mathematics and computer vision. It allows machines to interpret visual data efficiently and reliably.

Whether using least squares or RANSAC, understanding the math behind the method gives deeper insight into how machines "see" the world.