Term Related to binary classification
1. PRECISION
Precision in binary classification (Yes/No) refers to a model's ability to
correctly interpret positive observations. In other words, how often does a
positive value forecast turn out to be correct? We may manipulate this metric
by only returning positive for the single observation in which we have the
most confidence.
2. RECALL
The recall is also known as sensitivity. In binary classification (Yes/No)
recall is used to measure how “sensitive” the classifier is to detecting positive
cases. To put it another way, how many real findings did we “catch” in our
sample? We may manipulate this metric by classifying both results as
positive.
3. F1 SCORE
The F1 score can be thought of as a weighted average of precision and recall,
with the best value being 1 and the worst being 0. Precision and recall also
make an equal contribution to the F1 ranking.
Multiclass Classification
Multi-class classification is the task of classifying elements into different classes.
Unlike binary, it doesn’t restrict itself to any number of classes.
Examples of multi-class classification are
classification of news in different categories,
classifying books according to the subject,
classifying students according to their streams etc.
In these, there are different classes for the response variable to be classified in and
thus according to the name, it is a Multi-class classification.
Can a classification possess both binary or multi-class?
Let us suppose we have to do sentiment analysis of a person, if the classes are just
“positive” and “negative”, then it will be a problem of binary class. But if the
classes are “sadness”, happiness”, “disgusting”, “depressed”, then it will be called
a problem of Multi-class classification.
Binary vs Multiclass Classification
Parameters Binary classification Multi-class classification
It is a classification of two There can be any number of
No. of groups, i.e. classifies classes in it, i.e., classifies the
classes objects in at most two object into more than two
classes. classes.
Algorithms The most popular Popular algorithms that can be
used algorithms used by the used for multi-class
binary classification are- classification include:
k-Nearest Neighbors
Logistic Regression
Decision Trees
k-Nearest Neighbors
Decision Trees Naive Bayes
Support Vector Random Forest.
Machine Gradient Boosting
Naive Bayes
Examples of binary
classification include-
Examples of multi-class
Email spam
classification include:
detection (spam or
Face classification.
not).
Examples Plant species
Churn prediction
classification.
(churn or not).
Optical character
Conversion
recognition.
prediction (buy or
not).
2 methods by which we can implement a multiclass classifier using binary classifier :