(a) The Bayesian setup: The posterior distribution
Observe that if ̠₀, ̠₁ and ̤ are given, then each Yᐡ is a gaussian: Yᐡ | (̠₀, ̠₁, ̤) ~ ᄉ (̠₀ + ̠₁Xᐡ, 1/̤).
Therefore, the likelihood function of the vector (Y₁, . . . , Yₙ) given (̠₀, ̠₁, ̤) is of the form
(1/√(2π/̤))ⁿ exp (-̤/2 ∑ (yᐡ - ̠₀ - ̠₁Xᐡ)²)
It turns out that the distribution of (̠₀, ̠₁) given ̤ and Y₁, . . . , Yₙ is a 2-dimensional Gaussian. In terms of ᕁ, Y and ̤, what is its mean and covariance matrix?
Hint: look ahead and see what part (b) is asking. What answer do you hope would come out, at least for one of these two things?
(Type X for ᕁ, trans(X) for the transpose ᕁፀ, and X^(-1) for the inverse ᕁ⁻¹ of a matrix ᕁ.)
Mean:
Covariance:
(b)
What is the Bayes estimator (̠₀, ̠₁)^Bayes for (̠₀, ̠₁)?
Hint: Use your answer from part (a). However, as hinted: the answer here is guessable, even if you didn't solve the previous part.
(Answer in terms of ᕁ, Y and ̤.)
(Type X for ᕁ, trans(X) for the transpose ᕁፀ of a matrix ᕁ, and X^(-1) for the inverse ᕁ⁻¹ of a matrix ᕁ.)
(̠₀, ̠₁)^Bayes =