X -> Linear -> ReLU -> Linear -> Y
In the two-layer network shown above, let's initialize the layers. Which networks still train? Choose all possible answers:
a) First layer is zero, second random uniform.
b) First layer is random uniform, second zero.
c) First and second layer are zero.
d) First and second layer are random uniform.