Exercise 3
Given B identically distributed (but not necessarily independent) random variables Z1,..., ZB with positive
pairwise correlation p, show that
B
Var (1/B Σ Zb) = po² + (1-p)/B σ²
b=1
(4)
If we further assume random variables Z1,..., ZB are independent. What's the variance Var (1/B Σ Zb)?
Show that the variance is larger if random variables are not independent. Use this result to argue that why
bagging does not work as we expect.