Algorithms Class Notes
1. Introduction to Machine Learning
Machine Learning (ML) is a subfield of AI that enables systems to learn from data without explicit
programming.
Types of Learning:
- Supervised Learning
- Unsupervised Learning
- Reinforcement Learning
2. Supervised Learning
In supervised learning, the model is trained on labeled data.
Common algorithms:
- Linear Regression
- Logistic Regression
- Decision Trees
- Support Vector Machines (SVM)
- Neural Networks
3. Unsupervised Learning
Unsupervised learning deals with unlabeled data to discover hidden patterns.
Common algorithms:
- K-Means Clustering
- Hierarchical Clustering
- Principal Component Analysis (PCA)
Algorithms Class Notes
4. Model Evaluation
Metrics for classification:
- Accuracy
- Precision
- Recall
- F1-Score
Metrics for regression:
- Mean Squared Error (MSE)
- Mean Absolute Error (MAE)
- R-squared
5. Overfitting and Underfitting
Overfitting: Model learns noise in training data, poor generalization.
Underfitting: Model is too simple, fails to capture patterns.
Solutions:
- Cross-validation
- Regularization (L1, L2)
- More data
6. Neural Networks and Deep Learning
Neural Networks consist of layers of interconnected nodes (neurons).
Deep Learning uses multi-layer networks to learn complex representations.
Common architectures:
Algorithms Class Notes
- CNNs (images)
- RNNs (sequences)
- Transformers (language)