Subject
Computer Science
Topic
Artificial Intelligence
Why are activation functions used in neural networks?
Why are activation functions used in neural networks?
a)
To add non-linearity so the network can learn complex patternsb)
To store the training datac)
To reduce the number of layersd)
To sort the inputsExplanation
Without non-linear activations, any number of layers would act like a single linear layer.Related questions
In the figure, a perceptron has weights 1,1, input 0,0, bias -1.5, and threshold 0. What output does it produce?In the figure, a perceptron has weights 1,1, input 1,1, bias -1.5, and threshold 0. What output does it produce?In the figure, a perceptron has weights 1,-1, input 2,1, bias 0, and threshold 0. What output does it produce?In the figure, what is sigmoid(-2) rounded to three decimals?In the figure, what is sigmoid(2) rounded to three decimals?In the figure, a fully connected layer has 4 inputs and 3 neurons, with one bias per neuron. How many trainable parameters does it have?What output does a ReLU unit produce for input -3?A weight is 2, learning rate 0.1, and loss gradient 0.5. What is the weight after one gradient-descent step?