NLP evolution and the rise of transformers
NLP, or natural language processing, is the field of artificial intelligence that gives computers the ability to understand and manipulate human language using common spoken (or otherwise) language instead of what was traditionally given as input to computers in the past: computer programming language. Over the past several decades, these computer programming languages became more “natural” with fluency:
Figure 2.2 – Brief timeline of NLP evolution
Over time, there has been significant advancement in the field of NLP, with computers increasingly improving in their ability for text generation due to the emergence of neural networks. Text generation itself isn’t a novel idea, but earlier language models before 2017 predominantly utilized ML architectures known as recurrent neural networks (RNNs) and convolutional neural networks (CNNs).
RNNs are a type of neural network architecture...
