Activation Function
kittyloveSuppose you had a neural network with linear activation functions. That is, for each unit the output is some constant c times the weighted sum of the inputs.
- Assume that the network has one hidden layer. For a given assignment to the weights w, write down equations for the value of the units in the output layer as a function of w and the input layer x, without any explicit mention of the output of the hidden layer. Show that there is a network with no hidden units that computes the same function.
- Repeat the calculation in part (a), but this time do it for a network with any number of hidden layers.
- Suppose a network with one hidden layer and linear activation functions has n input and output nodes and h hidden nodes. What effect does the transformation in part (a) to a network with no hidden layers have on the total number of weights? Discuss the case h << n.
a year ago
15
other Questions(10)
- MGT Discussion
- information research paper
- Culturally Diverse Individuals Are Effective Workers
- Organizational Strategies of Adopting Health Policies
- What is the message in Social Geographies by Valentine " Ken Man only"
- Case Analysis-Microsoft
- Payment Link
- Pease follow direction and have assignment on time
- Read the documents on Newfoundland the Beothuk peoples in Chapter nine. Write two to three pages that answer the following question: Based on your reading of the primary documents, were Europreans in Newfoundland solely or chiefly responsible for the exti
- I'm looking for someone to write my Individual Application paper for my Customer relations in Business class.
