Linear Algebra and Random Processes

(CS6015)
DEPT. OF COMPUTER SCIENCE AND ENGINEERING
Indian Institute of Technology Madras

TUTORIAL 6
(Time allowed: FIFTY minutes)

NOTE: Attempt ALL questions. Total Marks : 40

1. If A, B, C are independent events and P (C) > 0, then are A and B conditionally independent given
C? If so, prove. (2 marks)

2. A telephone operator on an average handles 5 calls every 3 minutes. What is the probability that
there will be

(a) no calls in the next minute?

Solution:
If we denote X as the number of calls in a minute, then X has the poisson distribution with λ = 5/3.
So

3. Ten percent of computer parts produced by a certain supplier are defective. What is the probability
that a sample of 10 parts contains more than 3 defective ones? (3 marks)
Solution:

CONTINUED
4. Let X be 
a discrete random variable with the following PMF


 0.1 for k = 0
0.4 for k = 1



PX (k) = 0.3 for k = 2

0.2 for k = 3





0 otherwise

(a) Find E(X).

5. Let A and B be two events. Suppose the probability that neither A or B occurs is 2/3. What is the
probability that one or both occur? (2 marks)
Solution:
We are given P (Ac ∩ B c ) = 2/3 and asked to find P (A ∪ B).

CONTINUED
6. Data is taken on the height and shoe size of a sample of few students. Height is coded by 3 values:
1 (short), 2 (average), 3 (tall) and shoe size is coded by 3 values 1 (small), 2 (average), 3 (large).
The joint counts are given in the following table.

height or
shoe size 1 2 3
1 234 225 84
2 180 453 161
3 39 192 157

Let X be the coded shoe size and Y the height of a random person in the sample.
(a) Find the joint and marginal pmf of X and Y.
(b) Are X and Y independent? (5 marks)
Solution: The joint distribution is found by dividing each entry in the data table by the total
number of people in the sample. Adding up all the entries we get 1725. So the joint probability
table with marginals is

7. If X and Y are independent, prove that var(XY ) = σx2 σy2 + σx2 µ2y + σy2 µ2x where µ is the mean and
σ 2 is the variance. (3 marks)
Solution:

8. A lost tourist arrives at a point with 3 roads. The first road brings him back to the same point after
1 hour of walk. The second road brings him back to the same point after 6 hours of travel. The last
road leads to the city after 2 hours of walk. There are no signs on the roads. Assuming that the

CONTINUED
 tourist chooses a road equally likely at all times. What is the mean time until the tourist arrives to
the city. (3 marks)
Solution: Let T be the time it takes to reach the city, and Di be the event that the tourist chooses
road i for i = 1, 2, 3. To compute E[T ] we will condition on the road tourist picks at the first time:

9. The length of time X, needed by students in a particular course to complete a 1 hour exam is a
random(variable with PDF given by:
k(x2 + x) if 0 ≤ x ≤ 1,
f (x) =
0 otherwise
For the random variable X, find the cumulative distribution function. (3 marks)
Solution:

CONTINUED
10. Let X ∼ exp(λ). Find E(X 2 ) using the expectation formula. (2 marks)
Solution:

11. Find the expressions of first and second derivative of univariate Gaussian function. Also, draw the
plots of all the three functions (Gaussian, first derivative of the Gaussian, second derivative of the
Gaussian). (5 marks)
Solution:

12. Consider the standard bivariate normal distribution

f (x, y) = √1 1
exp(− 2(1−ρ 2 2
2 ) (x − 2ρxy + y )).
2π 1−ρ2

The covariance between X and Y is given as :

R∞ R∞
cov(X, Y ) = −∞ −∞
xyf (x, y)dxdy = ρ

which can be split into

CONTINUED
 R∞ −1 2 R∞
−∞
y √12π e 2 y ( −∞
xg(x, y)dx)dy

2
Prove that g(x, y) = √ 1
exp(− 21 (x−ρy)
(1−ρ2 ) ) (5 marks)
2π(1−ρ2 )

Solution: