Understanding Conditional Probabilities & Bayes Theorem in Intro Stats / AP Statistics

What is Conditional Probability?
Conditional probability refers to the probability of an event occurring given that another event has already occurred. It is denoted by P(A|B), read as 'the probability of A given B'. The calculation of conditional probability can be illustrated mathematically using the formula:

P(A|B) = P(A and B) / P(B),
provided that P(B) > 0.

This formula tells us how to adjust the probability of event A, considering that event B has occurred.

What is an Example of Conditional Probability?
Suppose in a deck of 52 cards, you want to find the probability of drawing an Ace given that you've already drawn a spade. Here, A is the event 'drawing an Ace' and B is the event 'drawing a spade'.

- P(A) = Probability of drawing an Ace = 4/52
- P(B) = Probability of drawing a spade = 13/52
- P(A and B) = Probability of drawing the Ace of spades = 1/52

Using the formula for conditional probability, we get:

P(A|B) = P(A and B) / P(B) = (1/52) / (13/52) = 1/13.

Hence, the probability of drawing an Ace given that a spade is drawn is 1/13.

What is Bayes' Theorem?
Bayes' Theorem is a fundamental concept that describes the probability of an event based on prior knowledge of conditions that might be related to the event. It allows us to update our initial beliefs with new evidence. The theorem is mathematically represented as:

P(A|B) = [P(B|A) * P(A)] / P(B),

where:
- P(A|B) is the posterior probability: the probability of event A occurring given B is true.
- P(B|A) is the likelihood: the probability of event B occurring given A is true.
- P(A) is the prior probability: the initial probability of event A occurring.
- P(B) is the marginal probability: the total probability of event B occurring.

What is an Example of Bayes' Theorem?
Suppose 1% of the population has a certain disease (Event D), and there is a test for the disease. The test is 99% accurate, meaning:
- If a person has the disease, the probability of a positive test result (T) is 99% (P(T|D) = 0.99).
- If a person does not have the disease, the probability of a negative test result is 99%, so the probability of a false positive is 1% (P(T|¬D) = 0.01).

Given a positive test result, what is the probability that the person actually has the disease (P(D|T))?

Using Bayes' Theorem:

P(D|T) = [P(T|D) * P(D)] / P(T).

We need P(T) which is calculated as:
P(T) = P(T|D) * P(D) + P(T|¬D) * P(¬D)
= (0.99 * 0.01) + (0.01 * 0.99)
= 0.0099 + 0.0099
= 0.0198.

Now apply Bayes' Theorem:

P(D|T) = [0.99 * 0.01] / 0.0198
= 0.0099 / 0.0198
= 0.5.

So, given a positive test result, the probability that the person actually has the disease is 50%.

Conclusion
Conditional probabilities and Bayes' Theorem are crucial tools in understanding and calculating the likelihood of events based on prior knowledge and new evidence. These concepts are widely used in various fields including statistics, finance, medicine, and machine learning to make informed decisions under uncertainty.

Intro Stats / AP Statistics: Understanding Conditional Probabilities & Bayes Theorem

Related

Recommended Videos