Problem 2. Linear Classifier (15 points)
Let {X1, X2} denote two feature dimensions (e.g., age and income), and Y ∈ {0, 1} denote the class labels of the observations. In Figure 1, we have three positive observations ("+" for Y = 1) and one negative observation ("-" for Y = 0). Please answer the following questions.
1. (10 points) Is there any logistic regression classifier using X1 and X2 that can perfectly classify the examples in Figure 1? What if we change the label of point (1, 2) from "+" to "-"?
2. (5 points) For predicting the samples in Figure 1, which model is better: Logistic Regression or Linear Regression? Please explain the reason.
Figure 1: Four data points in a two-dimensional feature space.