Starting with a single neuron and with a single layer of neurons, generate the transfer function of a multiple-layer network. Examine the inside of the artificial neural network, devise a transfer function for each layer, briefly research how a topology can be obtained, analyze recurrent neural networks, and investigate forward propagation, cost function, and backward propagation. Consider the following multilayer neural network with the transfer function for each layer:
Input
Sat. Linear Layer
Linear Layer
satlin(w'pIV )
3 = purelin(Wa' + B)
Where satlin is defined by:
( = 0 n < 0 0 = " 0 <n<1 ( = | " > |
Saturating Linear
satlin
And purelin is defined as:
Linear
( = "
purelin
Using Python and the corresponding libraries, sketch the following responses (plot the indicated variable versus p for (~3 < p < 3)). Given that
wl1 = 2, wi1 = 1, b1 = 2, bf = -1, wl1 = 1, wiz = -1, b1 = 0
ii, iii, iv, v, vi, a}