Long Short-Term Memory (LSTM)

Type of Recurrent Neural Network for Sequencing

• LSTM aims to address the instability of successive multiplicative updates by \(W^{(k)}\) which results in the vanishing/exploding gradient issues seen in RNNs.