Chapter 5. Sequential Data Processing
The major challenges that neural networks are trying to solve today are processing, understanding, compressing, and generating sequential data. Sequential data can be described vaguely as anything that has a dependency on the previous data point and the next data point. Handling different types of sequential data requires different techniques, although the basic approach can be generalized. We'll explore what the basic building blocks of sequential data processing units are as well as, the common problems and their widely accepted solutions.
In this chapter, we are going to look at sequential data. The canonical data that people use for sequential data processing is natural language, although time series data, music, sound, and others are also considered to be sequential data. Natural language processing (NLP) and understanding has been explored extensively and it's an active field of research right now. The human language...