Consider a neural network shown in the figure below. We have three inputs and two outputs.
The activation function used in hidden layer is the ReLU function and no activation function
is used at the output layer. The loss function chosen is given by: J=(1)/(2)|y-hat(y)|, where y
is the true training label vector, and hat(y) is the predicted output vector. You are given the
following transformations:
(a) [3 marks] Define the weight matrices and bias vectors for each layer using the ap-
propriate notation and specify their sizes.
(b) [5 marks] Formulate a set of equations for Forward pass.
(c) [2 marks] Calculate the total number of trainable parameters of the neural network.
(d) marks] Derive (delJ)/(delW_(ij)^(|3|))
(e) [5 marks] Now write (delJ)/(delW^(3)), i.e., use vector products.
(f) marks] Using your result from previous parts, derive (delJ)/(delW_(ij)^([2]))
**Please answer the question from c to f step by step . Don't skip the steps.**
Consider a neural network shown in the figure below. We have three inputs and two outputs The activation function used in hidden layer is the ReLU function and no activation function is used at the output layer. The loss function chosen is given by: J =|y - |, where y is the true training label vector, and g is the predicted output vector. You are given the following transformations:
[1]
[2] an
[1] ae
[3]
1
(2)
[2] as
[1]
(3) as
[1] as
[2] as
[1] as
(a) [3 marks] Define the weight matrices and bias vectors for each layer using the ap- propriate notation and specify their sizes. (b) [5 marks] Formulate a set of equations for Forward pass. (c) [2 marks] Calculate the total number of trainable parameters of the neural network
(f)[10 marks] Using your result from previous parts, derive aw