A review of probability:
June 11, 2018
1 Concepts
1. For any event A,
0 ≤ P (A) ≤ 1 (1)
2. For the sample space S,
P (S) = 1 (2)
3. The Complement Rule:
P (A) + P (Ac ) = 1 (3)
4. Basic law of probability:
P (A ∪ B) = P (A) + P (B) − P (A ∩ B) (4)
5. Disjoint/Mutually Exclusive Events:
P (A ∩ B) = 0 (5)
And therefore,
P (A ∪ B) = P (A) + P (B) (6)
6. Marginal Probability:
X
P (Ai ) = P (Ai ∩ Bj ) (7)
j
So, P (A1 ) = P (A1 ∩ B1 ) + P (A1 ∩ B2 ) etc.
1
7. Conditional Probability:
P (A ∩ B)
P (A|B) = (8)
P (B)
Symmetrically,
P (A ∩ B)
P (B|A) = (9)
P (A)
8. Joint Probability:
P (A ∩ B) = P (A) × P (B|A)
(10)
= P (B) × P (A|B)
9. Independent Events:
A and B are independent if
P (A|B) = P (A) (11)
or, equivalently, if
P (A ∩ B) = P (A) × P (B) (12)
10. Law of Total Probability:
If A1 , A2 , . . . An are mutually exclusive events and B is any arbitrary
event, then
X
P (B) = P (Ai )P (B|Ai )
i
X (13)
= P (Ai ∩ B)
i
11. Bayes’ theorem:
P (Ai )P (B|Ai )
P (Ai |B) = P (14)
i P (Ai )P (B|Ai )
For two events A1 and A2 ,
P (A1 )P (B|A1 )
P (A1 |B) = (15)
P (A1 )P (B|A1 ) + P (A2 )P (B|A2 )