Transformers and Their Applications

In this chapter, we will learn about transformers and how to apply them to perform various NLP tasks. Typical tasks in the NLP domain involve loading and processing data so that it can be used downstream seamlessly. Once the data is read, another task is that of transforming the data into a form that the various models can use. Once the data is transformed into the requisite format, we use it to perform the actual tasks, such as classification, text generation, and language translation.

Here is a list of the recipes in this chapter:

• Loading a dataset
• Tokenizing the text in your dataset
• Using the tokenized text to perform classification with Transformer models
• Using different Transformer models based on different requirements
• Generating text by taking a cue from an initial starting sentence
• Translating text between different languages using pre-trained Transformer models