Aum Sri Sai Ram
Introduction to Pattern
Recognition
1
Praying to Our Lord Sri Satya Sai Baba for His Blessings
Sergios Theodoridis
Konstantinos Koutroumbas
3
Course Details
Coverage
4
Prerequisite
Linear algebra
Probability & Statistics
Optimization
5
What is a Pattern?
“A pattern is the opposite of chaos; it is an
entity vaguely defined, that could be given
a name.”
A pattern is an abstract object, such as a
set of measurements describing a physical
object.
6
Examples of patterns
7
Pattern Recognition (PR)
definitions
8
Example problem
9
Why PR?
PR is an integral part of Machine intelligence systems:
Machine vision
Character recognition (OCR)
Computer aided diagnosis
Speech recognition
Face recognition
Biometrics
Image Data Base retrieval
Data mining
Bionformatics
The task: Assign unknown objects – patterns – into the correct
class. This is known as classification.
10
Role of Machine Learning(ML)
Principled way of building high performance
information processing systems
ML vs PR
ML has origins in Computer Science
PR has origins in Engineering
They are different facets of the same field
Language Related Technologies
IR, NLP, ASR
Human perform them well
Difficult to specify algorithm for these
11
What is ML?
Programming computers to use example data or past
experience
Well-Posed Learning Problems
– A computer program is said to learn from
experience E
– with respect to class of tasks T and performance
measure P,
– if its performance at tasks T, as measured by P,
improves with experience E
12
Features & Classifer
Features: These are measurable quantities obtained from
the patterns, and the classification task is based on their
respective values.
Feature vectors: A number of features
x1 ,..., xl ,
constitute the feature vector
x x1 ,..., xl R l
T
Feature vectors are treated as random vectors.
The classifier consists of a set of functions, whose values,
computed at x , determine the class to which the
corresponding pattern belongs
13
An example:
14
PR process
15
Classification system overview
16
Decision Boundary
17
Supervised – Unsupervised and Semi-supervised PR
The major directions
Supervised: Patterns whose class is known a-priori
are used for training.
Unsupervised/Clustering: The number of classes is
(in general) unknown and no training patterns of
known class labels are available.
Semi-supervised: A set of patterns of unknown class
along with training patterns of known classes.
18
Supervised PR
Classifier
19
Unsupervised PR
20
Semi-supervised PR
Classifier
21
Summary
What is PR & ML?
Why PR?
PR VS ML
PR System steps
Types of PR/ML
22