Machine Learning Basic Topics - Simplified Notes
1. What is Machine Learning? Types of Machine Learning
Machine Learning (ML) is a way to teach computers to learn from data and make decisions on their
own, without being told exactly what to do every time.
Types:
- Supervised Learning: Learns from data with answers (like predicting house prices).
- Unsupervised Learning: Learns patterns from data without answers (like grouping customers).
- Semi-supervised Learning: Mix of labeled and unlabeled data.
- Reinforcement Learning: Learns from rewards and penalties (like a robot learning to walk).
2. Types of Regularization & Difference between Lasso and Ridge
Regularization helps reduce overfitting.
- L1 Regularization (Lasso): Can make some features zero, helps in feature selection.
- L2 Regularization (Ridge): Reduces the effect of features but doesn't remove them.
Difference: Lasso removes features, Ridge shrinks them.
3. Regression & Types of Regression
Regression is used to predict numbers (continuous values).
Types:
- Linear Regression: Straight-line prediction.
- Polynomial Regression: Curve-based prediction.
- Ridge Regression: Linear regression with L2 regularization.
- Lasso Regression: Linear regression with L1 regularization.
- ElasticNet: Mix of Ridge and Lasso.
- Logistic Regression: Used for classification (yes/no).
4. Logistic Regression
Used to classify things like spam/not spam. Uses sigmoid function to give result between 0 and 1.
5. Decision Tree
A flowchart-like model that asks questions to make a decision. Easy to understand but can overfit.
6. Random Forest
A group of many decision trees. Each gives a prediction, final answer is by majority vote. More
accurate than a single tree.
7. 7 Algorithms in Supervised Learning
- Linear Regression
- Logistic Regression
- Decision Tree
- Random Forest
- K-Nearest Neighbors (KNN)
- Naive Bayes
- Support Vector Machine (SVM)