In this section, we will carry out three different experiments to search for an improved LSTM based movie review sentiment classification model. This will involve trying a different optimizer at the time of compiling the model, adding another LSTM layer when developing the model architecture, and using a bidirectional LSTM layer in the network.
Performance optimization tips and best practices
Experimenting with the Adam optimizer
We will use the adam (Adaptive Moment Optimization) optimizer instead of the rmsprop (Root Mean Square Propagation) optimizer that we used earlier when compiling the model. To make a comparison of model performance easier, we will keep everything else the same as earlier, as shown in the following...