Text summarization is one of the most popular applications of natural language processing. In this chapter, we will understand how to fine-tune the pre-trained BERT model for a text summarization task. The BERT model fine-tuned for the text summarization task is often called BERTSUM (BERT for summarization). In this chapter, we will understand what BERTSUM is and how it is used for text summarization in detail.
We will begin the chapter by understanding different types of text summarization called extractive and abstractive summarizations. First, we will learn how to perform extractive summarization using BERTSUM with a classifier, BERTSUM with a transformer, and BERTSUM with an LSTM. Next, we will look into how BERTSUM is used for performing the abstractive summarization task.
Going forward, we will learn about the text summarization...
