1. (20 pts) Compute $s^{(l)}$, $x^{(l)}$, $\delta^{(l)}$ and $\frac{\partial e}{\partial w^{(l)}}$ with $x = 2, y = 2$
Added by Linda M.
Close
Step 1
3$ $w_{12} = 0.4$ $w_{21} = 0.1$ $w_{22} = 0.2$ $w_{31} = 0.4$ $w_{32} = 0.2$ $w_{33} = 0.1$ The input is $x = 2$. The first layer is: $s_1^{(1)} = 1 \times w_{11} + x \times w_{21} = 1 \times 0.3 + 2 \times 0.1 = 0.5$ $s_2^{(1)} = 1 \times w_{12} + x \times Show more…
Show all steps
Your feedback will help us improve your experience
Andreas Papavassiliou and 59 other AP CS educators are ready to help you.
Ask a new question
Labs
Want to see this concept in action?
Explore this concept interactively to see how it behaves as you change inputs.
Key Concepts
Recommended Videos
Andreas P.
Neural Network. Consider a three-layer neural network to learn a function f : X → Y, where X = [X1, X2] consists of two features. The weights w1,...,w6 can be arbitrary. There are two possible choices for the function implemented by each unit in this network: - S: sigmoid function, S(z) = 1/(1+exp(-z)) - L: linear function, L(z) = cz where in both cases z = Σi wi Xi. Assign proper activation functions (S or L) to each unit in the following graph so that we can generate functions of the form f(X1, X2) = 1/(1+exp(β1 X1 + β2 X2)) at the output of the neural network Y. Derive β1 and β2 as a function of w1,...,w6.
Shaiju T.
Consider MLP with one input, two layers, one neuron in each layer, and one output. The activation function of the first layer is f(n) = 2n, and the activation function of the second layer is f(2)(n) = 3n. The initial weights of the first and the second layers are respectively w(1) = 0 and w(2) = 0. There are no bias terms, so b(1) = 0 and b(2) = 0, and they are kept zero during training. Assume that we present the data point with x = 2 and y = 2 to the network. Perform one step of the Stochastic Gradient Descent algorithm by using the backpropagation algorithm, assuming the learning rate = 0.05. Use the MSE objective function, i.e. J = (y - a(2))^2. This means that you should calculate the updated weights.
Akash M.
Recommended Textbooks
Computer Science and Information Technology
Introduction to Programming Using Python
Computer Science - An Overview
Transcript
18,000,000+
Students on Numerade
Trusted by students at 8,000+ universities
Watch the video solution with this free unlock.
EMAIL
PASSWORD