The hidden layer and output layer neurons have outputs given by z = h(xi) and Yh. Assume the network has D = 2 inputs, M = 3 hidden units, and K = 2 outputs. The bias units have constant values o = Zo = 1. Assume that the activation functions in the hidden layer are ReLU functions and that the activation functions in the output layer are given by the softmax function.
Suppose that the weights are given by:
W10 = 0.4, W20 = -1.7, W21 = -0.5, W30 = 1.7
Suppose that the input to this network is given by 1 = -0.8 and 2 = 1.
Give the output of the second hidden layer neuron to two decimal places.