Python for Data Science
[email protected]
FK4AW1IM38
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Agenda
1. Pop Quiz
2. Common Python Libraries for Data Science
3. NumPy and Pandas
4. Common NumPy functions
5. Common Pandas functions
[email protected]
6. Merge vs Join
FK4AW1IM38 in Pandas
7. Example of Join
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Pop Quiz
1. What are the data types in Python?
2. What are some of the common Python libraries for Data Science?
3. Can you list some of the common functions in Pandas?
4. What are the applications of the functions like group by, merge, join etc?
[email protected]
FK4AW1IM38
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited. 3
Common Python Libraries for Data Science
Library Use
NumPy Handling multi-dimensional arrays
Scipy Scientific computation package
Matplotlib, Seaborn Data visualisation
[email protected]FK4AW1IM38
Pandas Handling tabular data
Scikit-learn Machine learning
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
NumPy
● Stands for Numerical Python
● It is one of the fundamental packages for mathematical, logical, and statistical operations with
Python
● It contains
○ Powerful N-dimensional array object, called ndarray
[email protected]FK4AW1IM38○ Large set of functions for creating, manipulating, and transforming ndarrays
● ndarrays can only contain data of a single datatype
● Useful in linear algebra, vector calculus, random number capabilities, etc
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Pandas
● Pandas is one of the fundamental packages for analysis and manipulation of tabular data
● Offers two major data structures - series & dataframe
● We can think of a pandas dataframe like an excel spreadsheet that is storing some data in rows and
columns.
● A pandas dataframe is made up of several pandas series
[email protected]
FK4AW1IM38○ Each column of a dataframe is a series.
● Pandas dataframes can contain data of multiple datatypes
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Common NumPy Functions
Function Description
np.array() To create an array
np.arange() Return evenly spaced values within a given interval
np.linspace() Return evenly spaced numbers over a specified interval
[email protected]FK4AW1IM38
np.zeros() To create an array of zeros
np.ones() To create an array of ones
np.transpose() Permute array dimensions
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Common NumPy Functions
Function Description
np.random.rand() To create an array of specified shape filled with random values
np.random.randint() Return random integers from low (inclusive) to high (exclusive)
np.random.randn() Return a sample (or samples) from the “standard normal” distribution.
[email protected]
np.concatenate()
FK4AW1IM38
Concatenate two arrays
np.save() Save an array to a binary file in .npy format.
np.savez() Save several arrays into a single file in uncompressed .npz format.
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Common Pandas Functions
Function Description
pd.read_csv() Read a comma-separated values (csv) file into DataFrame
df.loc[] Access a group of rows and columns by label(s)
df.iloc[] Purely integer-location based indexing for selection by position
[email protected]FK4AW1IM38
df.drop() Drop specified labels from rows or columns
pd.concat() To concatenate two pandas objects
pd.merge() To merge the pandas dataframes
df.groupby() To split, apply or combine the data structures
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Common Pandas Functions
Function Description
df.value_counts() To get count of some attributes
df.unique() To get unique values
df.dtype To get the data types
[email protected]FK4AW1IM38
df.shape To get the shape (number or rows and columns)
df.head() To get the top rows
df.tail() To get the last rows
df.describe() To get the quick statistic summary
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Merge vs Join
• Join: The join method works best when we are joining dataframes on their indexes (though you
can specify another column to join on for the left dataframe).
• Merge: The merge method is more versatile and allows us to specify columns besides the index
to join on for both dataframes.
Natural join - Full outer join -
Left outer join Right outer join
Intersection Union
[email protected]FK4AW1IM38To keep only rows To keep all rows from To include all the To include all the
that match from the both data frames, rows of your data rows of your data
data frames frame x and only frame y and only
those from y that those from x that
match match,
how=‘inner’. how=‘outer’. how =‘left’. how=‘right’.
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Example of Join
[email protected]
FK4AW1IM38
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Example of Join
[email protected]
FK4AW1IM38
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action.
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
Happy Learning !
[email protected]FK4AW1IM38
This file is meant for personal use by [email protected] only.
Sharing or publishing the contents in part or full is liable for legal action. 14
Proprietary content. © Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited.
