Scribd
Upload
11 views11 pages

ML Module II

Module II of CSC604 focuses on the mathematical foundations essential for machine learning, covering topics such as systems of linear equations, norms, inner products, and orthogonal vectors. It also discusses symmetric positive definite matrices, determinants, eigenvalues, and singular value decomposition (SVD) along with their applications. The module emphasizes the importance of understanding these concepts for effective machine learning practices.

Uploaded by

yashsp20phpcomp
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
11 views11 pages

ML Module II

Module II of CSC604 focuses on the mathematical foundations essential for machine learning, covering topics such as systems of linear equations, norms, inner products, and orthogonal vectors. It also discusses symmetric positive definite matrices, determinants, eigenvalues, and singular value decomposition (SVD) along with their applications. The module emphasizes the importance of understanding these concepts for effective machine learning practices.

Uploaded by

yashsp20phpcomp
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 11

CSC604 (Machine Learning)

Module II
➢ BY:
DR. ARUNDHATI DAS
Module II: Mathematical Foundation for ML
• 2.1 System of Linear equations, Norms, Inner products, Length of
Vector, Distance between vectors, Orthogonal vectors
• 2.2 Symmetric Positive Definite Matrices, Determinant, Trace,
Eigenvalues and vectors, Orthogonal Projections, Diagonalization,
SVD and its applications

2
Module II: Mathematical Foundation for ML
• 2.1 System of Linear equations, Norms, Inner products, Length of
Vector, Distance between vectors, Orthogonal vectors

3
System of Linear equations
• A system of linear equations is a collection of equations that share the same
set of variables. For example:

• Matrix Representation: The system can be written in matrix form as—


• Ax=b
where: A is the coefficient matrix, x is the vector of unknowns, b is the constant vector.
4
Norms
• A norm measures the size or length of a vector in a vector space. The most
common norms are:
1) Euclidean Norm (L2 norm):
2) L1 Norm (Manhattan norm):
3) Infinity Norm (Max norm):

5
Inner products
• An inner product defines the "dot product" or "scalar product" in a
vector space.
• In , it is given by:

6
Length of Vector
• The length (or magnitude) of a vector is derived using its Euclidean
norm:

• For example, for v=[3,4]

7
Distance Between Vectors
• The distance between two vectors, u and v, is defined as the norm of
their difference:

• Where,

8
Orthogonal Vectors
• Two vectors are orthogonal if their inner product is zero:
• <u, v>=0

• For example,

Orthogonality implies the vectors are at a 90° angle.

9
Module II: Mathematical Foundation for ML
• 2.2 Symmetric Positive Definite Matrices, Determinant, Trace,
Eigenvalues and vectors, Orthogonal Projections, Diagonalization,
SVD and its applications

10
All the numericals done on board are
important.
THANK YOU

11

You might also like