Jump to content

Law of total probability

From Wikipedia, the free encyclopedia

In probability theory, the law (or formula) of total probability is a fundamental rule relating marginal probabilities to conditional probabilities. It expresses the total probability of an outcome which can be realized via several distinct events, hence the name.

Statement

[edit]

The law of total probability is[1] a theorem that states, in its discrete case, if {Bn:n=1,2,3,…} is a finite or countably infinite set of mutually exclusive and collectively exhaustive events, then for any event A

P(A)=∑nP(A∩Bn)

or, alternatively,[1]

P(A)=∑nP(A∣Bn)P(Bn),

where, for any n, if P(Bn)=0, then these terms are simply omitted from the summation since P(A∣Bn) is finite.

The summation can be interpreted as a weighted average, and consequently the marginal probability, P(A), is sometimes called "average probability";[2] "overall probability" is sometimes used in less formal writings.[3]

The law of total probability can also be stated for conditional probabilities:

P(A∣C)=P(A,C)P(C)=∑nP(A,Bn,C)P(C)=∑nP(A∣Bn,C)P(Bn∣C)P(C)P(C)=∑nP(A∣Bn,C)P(Bn∣C)

Taking the Bn as above, and assuming C is an event independent of any of the Bn:

P(A∣C)=∑nP(A∣C,Bn)P(Bn)

Continuous case

[edit]

The law of total probability extends to the case of conditioning on events generated by continuous random variables. Let (Ω,ℱ,P) be a probability space. Suppose X is a random variable with distribution function FX, and A an event on (Ω,ℱ,P). Then the law of total probability states

P(A)=∫−∞∞P(A|X=x)dFX(x).

If X admits a density function fX, then the result is

P(A)=∫−∞∞P(A|X=x)fX(x)dx.

Moreover, for the specific case where A={Y∈B}, where B is a Borel set, then this yields

P(Y∈B)=∫−∞∞P(Y∈B|X=x)fX(x)dx.

Example

[edit]

Suppose that two factories supply light bulbs to the market. Factory X's bulbs work for over 5000 hours in 99% of cases, whereas factory Y's bulbs work for over 5000 hours in 95% of cases. It is known that factory X supplies 60% of the total bulbs available and Y supplies 40% of the total bulbs available. What is the chance that a purchased bulb will work for longer than 5000 hours?

Applying the law of total probability, we have:

P(A)=P(A∣BX)⋅P(BX)+P(A∣BY)⋅P(BY)=99100⋅610+95100⋅410=594+3801000=9741000

where

  • P(BX)=610 is the probability that the purchased bulb was manufactured by factory X;
  • P(BY)=410 is the probability that the purchased bulb was manufactured by factory Y;
  • P(A∣BX)=99100 is the probability that a bulb manufactured by X will work for over 5000 hours;
  • P(A∣BY)=95100 is the probability that a bulb manufactured by Y will work for over 5000 hours.

Thus each purchased light bulb has a 97.4% chance to work for more than 5000 hours.

Other names

[edit]

The term law of total probability is sometimes taken to mean the law of alternatives, which is a special case of the law of total probability applying to discrete random variables.[citation needed] One author uses the terminology of the "Rule of Average Conditional Probabilities",[4] while another refers to it as the "continuous law of alternatives" in the continuous case.[5] This result is given by Grimmett and Welsh[6] as the partition theorem, a name that they also give to the related law of total expectation.

See also

[edit]

Notes

[edit]
  1. 1 2 Zwillinger, D., Kokoska, S. (2000) CRC Standard Probability and Statistics Tables and Formulae, CRC Press. ISBN 1-58488-059-7 page 31.
  2. ↑ Pfeiffer, Paul E. (1978). Concepts of probability theory. Courier Dover Publications. pp. 47–48. ISBN 978-0-486-63677-1.
  3. ↑ Rumsey, Deborah (2006). Probability for dummies. For Dummies. p. 58. ISBN 978-0-471-75141-0.
  4. ↑ Pitman, Jim (1993). Probability. Springer. p. 41. ISBN 0-387-97974-3.
  5. ↑ Baclawski, Kenneth (2008). Introduction to probability with R. CRC Press. p. 179. ISBN 978-1-4200-6521-3.
  6. ↑ Probability: An Introduction, by Geoffrey Grimmett and Dominic Welsh, Oxford Science Publications, 1986, Theorem 1B.

References

[edit]
  • Beaver, Robert J.; Beaver, Barbara M. (2005). Introduction to Probability and Statistics. Thomson Brooks/Cole. p. 159.
  • Schervish, Mark J. (1995). Theory of Statistics. Springer.
  • Schiller, John J.; Lipschutz, Seymour (2010). Schaum's Outline of Probability (Second ed.). McGraw–Hill Professional. p. 89.
  • Tijms, H. C. (2003). A First Course in Stochastic Models. John Wiley and Sons. pp. 431–432.
  • Gut, Alan (1995). An Intermediate Course in Probability. Springer. pp. 5–6.