AIM:
To perform data manipulation using numpy and pandas and data visualization using matplotlib.
Program:
A. Data Manipulation using Numpy
NumPy stands for Numerical Python. NumPy is a python library used for working with arrays.
array(): Used to create numpy ndarray
copy(): It is a new array and it owns the data and any changes made to the copy will not affect
original array
view():View is just a view of the original array.The view does not own the data and any changes
made to the view will affect the original array
reshape() : Used to change the dimensions of the array
concatenate(): Used to join two or more arrays into single array
split(): Splitting is reverse operation of Joining. Array and number of splits are passed as
argument.
where(): search an array for a certain value, and return the indexes that get a match
sort(): Sorting means putting elements in an ordered sequence.
random: Module to work with random numbers
1. Program to create array and perform reshape:
import numpy as np
arr = np.array([1, 2, 3, 4, 5, 6])
x=arr.reshape(2,3)
print( x)
Output:
[[1 2 3]
[4 5 6]]
2. Program to demonstrate copy and view
import numpy as np
arr = np.array([1, 2, 3, 4, 5])
x = arr.copy()
arr[0] = 42
print(arr)
print(x)
arr = np.array([11, 12, 13, 14, 15])
y = arr.copy()
arr[0] = 42
print(arr)
print(y)
Output:
[42 2 3 4 5]
[1 2 3 4 5]
[42 12 13 14 15]
[42 12 13 14 15]
3. Program to demonstrate concatenate and split
import numpy as np
arr1 = np.array([1, 2, 3])
arr2 = np.array([4, 5, 6])
arr = np.concatenate((arr1, arr2))
print(arr)
print(np.split(arr,2))
Output:
[1 2 3 4 5 6]
[array([1, 2, 3]), array([4, 5, 6])]
4. Program to demonstrate sorting and searching
import numpy as np
arr = np.array([3, 2, 0, 1])
print(np.sort(arr))
print(np.where(arr==2))
Output:
[0 1 2 3]
3
B. Data Manipulation using Pandas
Pandas is a python library that allow us to analyze big data and make conclusions based on
statistical theories.
read_csv(dataset name): Used to load dataset
dropna(): Used to remove rows or columns with missing values
fillna(): Used to replace the NaN values with other values
mean(): Used to find the mean of the values for the requested axis
sum(): Function return the sum of the values for the requested axis
count(): is used to count the no. of non-NA/null observations across the given axis.
1. Program for handling missing data:
import numpy as np
import pandas as pd
# Load Dataset
dframe = pd.read_csv(‘Data.csv’)
print(dframe)
# Dropping missing data
dframe.dropna(inplace = True)
print(dframe)
# Filling missing data with mean
dframe.fillna(value = dframe.mean(), inplace = True)
print(dframe)
Output:
a b c
0 23 10.0 0.0
1 24 12.0 NaN
2 22 NaN NaN
a b c
0 23 10.0 0.0
a b c
0 23 10.0 0.0
1 24 12.0 0.0
2 22 11.0 0.0
2. Program for merge and join of data frame using panda:
import numpy as np
import pandas as pd
left = pd.DataFrame({'Key': ['K0', 'K1', 'K2', 'K3'], 'A': ['A0', 'A1', 'A2', 'A3'],
'B': ['B0', 'B1', 'B2', 'B3']})
right = pd.DataFrame({'Key': ['K0', 'K1', 'K2', 'K3'], 'C': ['C0', 'C1', 'C2', 'C3'],
'D': ['D0', 'D1', 'D2', 'D3']})
# Merging the dataframes
print(pd.merge(left, right, how ='inner', on ='Key'))
# Joining the dataframes
left = pd.DataFrame({'A': ['A0', 'A1', 'A2', 'A3'],
'B': ['B0', 'B1', 'B2', 'B3']}, index= ['K0', 'K1', 'K2', 'K3'])
right = pd.DataFrame({'C': ['C0', 'C1', 'C2', 'C3'],
'D': ['D0', 'D1', 'D2', 'D3']}, index= ['K0', 'K1', 'K2', 'K3'])
print(left.join(right))
Output:
Key A B C D
0 K0 A0 B0 C0 D0
1 K1 A1 B1 C1 D1
2 K2 A2 B2 C2 D2
3 K3 A3 B3 C3 D3
A B C D
K0 A0 B0 C0 D0
K1 A1 B1 C1 D1
K2 A2 B2 C2 D2
K3 A3 B3 C3 D3
3. Program for aggregation in panda:
import numpy as np
import pandas as pd
df = pd.read_csv(‘data.csv’)
print(df)
# Mean
print(df.mean())
# Count
print(df.count())
# Median
print(df.median())
# Sum
print(df.sum())
#Mad (Mean Absolute Deviation)
print(df.mad())
# Std (Standard deviation)
print(df.std())
# Var (Variance)
print(df.var())
Output:
A B
0 0.374540 0.155995
1 0.950714 0.058084
2 0.731994 0.866176
3 0.598658 0.601115
4 0.156019 0.708073
A 0.562385
B 0.477888
dtype: float64
A 5
B 5
dtype: int64
A 0.598658
B 0.601115
dtype: float64
A 2.811925
B 2.389442
dtype: float64
A 0.237685
B 0.296679
dtype: float64
A 0.308748
B 0.353125
dtype: float64
A 0.095325
B 0.124697
dtype: float64
C. Data Visualization using Matplotlib
Matplotlib is a multi-platform data visualization library built on NumPy arrays. Matplotlib
consists of several plots like line, bar, scatter, histogram etc.
figure(): Thought of as a single container that contains all the objects representing axes, graphics,
text, and labels
axes(): Bounding box with ticks and labels, which will eventually contain the plot elements that
make up our visualization.
xlim(), ylim(): Used to set x and y limit for axis
axis[xmin,xmax,ymin,ymax]: Used to set x and y limit for axis
xlabel(), ylabel(): Used to set label for axis
legend(): Used to set label for multiple plot lines in graph
plt.axis(‘equal’): Equal splitting of x and y limit values
plt.axis(‘tight’): Default spacing left between values of x and y limits
plt.savefig(): Used to save the output graph to specified format
1. Line Drawing
Program:
import matplotlib.pyplot as plt
import numpy as np
plt.style.use('seaborn-whitegrid')
fig = plt.figure()
plt.xlim(1,10)
plt.ylim(1,20)
plt.axis('tight')
plt.title('Sin ans Cos curves')
plt.xlabel('x')
plt.ylabel('Y')
x=np.linspace(1,20,10)
plt.plot(x, x + 0, linestyle='solid', linewidth=5,label='solid')
plt.plot(x, x + 1, linestyle='dashed',label='dashed')
plt.plot(x, x + 2, linestyle='dashdot',label='dash dot')
plt.plot(x, x + 3, linestyle='dotted',label='dotted')
plt.legend()
plt.savefig(‘sincos.png’) #Output graph saved into png format in current folder
Output:
2. Scatter Plot
Program:
import matplotlib.pyplot as plt
import numpy as np
plt.xlim(1,10)
plt.ylim(0,10)
plt.title('Scatter plots')
plt.xlabel('x axis')
plt.ylabel('Y axis')
x = np.linspace(0, 10, 10)
y = x+2
plt.plot(x, y, 'o', color=' green ') #scatter plot using plt.plot()
OR
plt.scatter(x,y,marker='o',color='green') #scatter plot using plt.scatter()
plt.savefig(‘scatter.pdf’) #Output graph saved into pdf format in current folder
Output:
3. Bar chart
Program:
import matplotlib.pyplot as plt
# x-coordinates of left sides of bars
left = [1, 2, 3, 4, 5]
# heights of bars
height = [10, 24, 36, 40, 5]
# labels for bars
tick_label = ['one', 'two', 'three', 'four', 'five']
# plotting a bar chart
plt.bar(left, height, tick_label = tick_label,
width = 0.8, color = ['red', 'green'])
# naming the x-axis
plt.xlabel('x - axis')
# naming the y-axis
plt.ylabel('y - axis')
# plot title
plt.title('My bar chart!')
Output:
+
