LSTM networks for time series data

In this recipe, we will learn what LSTM networks are and how can they be leveraged to better predict time series data with long-term memory characteristics.

LSTM networks

LSTM is designed to avoid the long-term dependency problem. It remembers the information for a longer period of time.

All recurrent neural networks have the form of a chain of repeating modules of a neural network. In standard RNNs, this repeating module will have a very simple structure, such as a single tanh layer. LSTMs also have this chain-like structure, but the repeating module has a different structure.

There are four layers, interacting in a very special way, as shown in the following diagram:

Reference...