Course Notes:
Mathematics
What Is a Matrix ?
Scalars
▪ Collection of numbers ordered in rows and columns
▪ Scalars are all numbers from algebra of dimension 0, 2ₓ1 column vector
can be considered as 1ₓ1 matrix
of length 2
▪ Vectors are matrices with either 1 row or 1 column
depending whether we have row vector or column
vector 1ₓ3 row vector
of length 3
▪ Matrices can be added, subtracted and multiplied
What Is a Matrix ?
! The length of a vector is the number of elements in it
A is 𝐦ₓ𝐧 matrix with 𝐚ᵢₖ denoting the
element on 𝐢𝐭𝐡 row and 𝐤 𝐭𝐡 column
NB: When coding, indexing starts from 0, so the
element in 1st row and 1st column is denoted as a00
Linear Algebra and Python Implementation
▪ Scalars are like a point
1 0 0
0 1 0
0 0 1
▪ Vectors are lines with direction
▪ Matrices represent planes, any 2-dimensional
! The 3D plane can be represented by the matrix
plane can be represented by a matrix
Linear Algebra and Python Implementation
▪ The simplest and most flexible way to work with
matrices in Python is by using arrays via the NumPy
library
Vectors Matrices Row vector
‘reshape’ gives an array a new
shape without changing its data
Tensors, Addition and Subtraction of Matrices
▪ Tensor is a collection of matrices Adding
vectors
Creating
a tensor
Adding vectors
with a scalar
In order to add and subtract matrices and Addition and subtraction is done
NB:
vectors their forms must match
! elementwise for both vectors and
matrices
Transpose
The operation of transposing turns a row vector into
! column one and vice-versa
Transposing an
array in Python
𝑇
1 1
= 1 and 𝑇 = 2
2 2 3 1 2 3
3 3
! Transposing a matrix turns each row into column
𝑇
𝑇 1 4 1 4
1 2 3 1 2 3
= 2 5 and 2 5 =
4 5 6 4 5 6
3 6 3 6
Dot Product
Dot product Dot product
of vectors between scalars
This is just normal multiplication,
2 1 !
8 . −7 =2x1+8x(-7)+(-4)x3=-66 but remember that Python interprets
−4 3 scalar as 1x1 arrays
We can take dot product only
NB:
between vectors of equal length, Multiplication of
the result of which is a scalar vector by a scalar
The resulting vector consists of scaled
!
components of the initial one
Dot Product of Matrices
Multiplying matrix Multiplication
by a scalar of matrices
Can only multiply an mₓn with an nₓk matrix; the importance
NB:
here is that the 2nd dimension of the first matrix matches the 1st
dimension of the second one to give an mₓk matrix
Scale each element in
!
the matrix by the scalar
Perform the dot product of each row with from 1st matrix with
!
each column from the 2nd one
Dot product of 𝑖 𝑡ℎ row vector of 1st matrix with 𝑗𝑡ℎ column vector of
!
2nd matrix gives the element on position (𝑖, 𝑗) in the resulting matrix