Subject
Computer Science
Topic
Artificial Intelligence
Long Short-Term Memory (LSTM) networks were introduced to overcome which problem of ordinary RNNs?
Long Short-Term Memory (LSTM) networks were introduced to overcome which problem of ordinary RNNs?
a)
Too few parametersb)
Inability to process numbersc)
Overfitting on small imagesd)
Vanishing gradients over long sequencesExplanation
LSTM cells use gates to keep information for many time steps. They were introduced by Hochreiter and Schmidhuber in 1997.Related questions
In the figure, a perceptron has weights 1,1, input 0,0, bias -1.5, and threshold 0. What output does it produce?In the figure, a perceptron has weights 1,1, input 1,1, bias -1.5, and threshold 0. What output does it produce?In the figure, a perceptron has weights 1,-1, input 2,1, bias 0, and threshold 0. What output does it produce?In the figure, what is sigmoid(-2) rounded to three decimals?In the figure, what is sigmoid(2) rounded to three decimals?In the figure, a fully connected layer has 4 inputs and 3 neurons, with one bias per neuron. How many trainable parameters does it have?What output does a ReLU unit produce for input -3?A weight is 2, learning rate 0.1, and loss gradient 0.5. What is the weight after one gradient-descent step?