In this mini project, you are asked to verify the strong law of large numbers (SLLN) and the central limit theorem (CLT). Let X1, X2, ..., Xn be independent random variables with mean μ and variance σ^2.
The Strong Law of Large Numbers states that the arithmetic average of n independent random variables will converge to their mean with probability 1.
The Central Limit Theorem states that the sum of n independent random variables will converge to a normal random variable in distribution.
The aim of this project is to have an idea about the rate of this convergence. How large should n be for reasonable convergence?
PART A
In the first part, you are required to find an answer to the above question for the SLLN. Let Xi ~ U[0,1], that is our i.i.d. random variables have a standard uniform distribution. Hence, in our case, sample successive observations from a standard uniform distribution and calculate the average of the generated observations. Draw the graph of the average vs. the number of observations. Using this graph, comment on how large n should be for the SLLN to kick in and the average to be close enough to the expected value of 1/2.
PART B
You are required to repeat the convergence analysis for the CLT this time. Generate samples with size m = 1000 of sums of n i.i.d. standard uniform random variables for different values of n. Let Ui ~ U[0,1] be i.i.d. computer-generated variates. Here is a table to provide you an idea: