Suppose we want to predict a continuous response Y. The true conditional expectation of Y is given by,
E(Y | X, Z) = ̠₀ + ̠₁X + ̠₂Z
here Z is a continuous but an unobserved predictor and X is an observed continuous predictor. From the real life data we can only observe y₁, y₂, ..., yₙ and x₁, x₂, ..., xₙ and fit the following model,
ŷሱ = ̠͂₀ + ̠͂₁xሱ
Then answer the following problems,
(a) [4 Marks] The estimator ̠͂₁ is a biased estimator. Calculate the bias of the estimator. That is calculate ̠₁ − ᄃ(̠͂₁). Show the detailed derivations.
(b) [2 Marks] Calculate the Var(̠͂₁ | X₁, X₂) using the fitted model under the constant variance assumption. Show the detailed derivations.
(c) [4 Marks] Now imagine that there Y is a n ! 1 vector, X₁ is a n ! (k + 1) matrix (where the first column is the column of 1s). ̠₁ = (̠₀, ̠₁, ..., ̠ₖ)′ is a (k + 1) ! 1 vector, X₂ is a n ! (p − k − 1) matrix and ̠₂ = (̠ₖ₁₁, ̠ₖ₁₂, ..., ̠ₑ)′ is a (p − k − 1)) ! 1 vector. The true model is provided by,
ᄃ(Y | X₁, X₂) = X₁̠₁ + X₂̠₂
and the fitted model is given by
Ŷ = X₁̠͂₁
again the ̠͂₁ is a biased estimator. Calculate the bias that is, ̠₁ − ᄃ(̠͂₁). Show the detailed derivations.