Advanced deep learning text classification
Our basic deep learning model is much less complex than the traditional machine learning approach, but its performance is not quite as good. This section looks at some advanced techniques for text classification in deep learning. The following sections explain a number of different approaches and focus on code examples rather than heavy deep explanations. If you are interested in more detail, then look at the book Deep Learning by Goodfellow, Bengio, and Courville (Goodfellow, Ian, et al. Deep learning. Vol. 1. Cambridge: MIT Press, 2016.). Another good reference that covers NLP in deep learning is a book by Yoav Goldberg (Goldberg, Yoav. Neural network methods for natural language processing).
1D convolutional neural network model
We have seen that the bag-of-words approach in traditional NLP approaches ignores sentence structure. Consider applying a sentiment analysis task on the four movie reviews in the following table:
Id | sentence | Rating (1=recommended... |
