Skip to content

Latest commit

 

History

2 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

📊 Polynomial Regression with Ridge Regularization

This project demonstrates a complete end-to-end regression modeling workflow following a structured data science process.

Starting from a baseline Linear Regression model, we:

Evaluated performance using cross-validation

Compared results against a mean baseline

Diagnosed underfitting

Introduced Polynomial Features (degree=2) to capture non-linear relationships

Applied Ridge regularization to control variance

Tuned hyperparameters using GridSearchCV

Evaluated final performance on a held-out test set

🔎 Final Model Performance

Test RMSE: ~0.76

Test R²: ~0.93

The final model (Polynomial Features + Ridge Regression) explains 93% of the variance in unseen data, demonstrating strong generalization and proper bias–variance tradeoff management.

🚀 Key Concepts Demonstrated

Bias–variance tradeoff

Cross-validation

Feature engineering (interaction & quadratic terms)

Regularization (L2 / Ridge)

Model evaluation and diagnostics

Proper train/test workflow

This repository illustrates a practical and interview-ready example of structured regression modeling in Python using scikit-learn.

About

Polynomial regression with Ridge regularization — end-to-end regression workflow on a vehicles dataset (R²=0.93) using scikit-learn

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages