Sentence augmentation

Sentence augmenting uses generative AI to create new texts. Examples of AI models are BERT, Roberta, GPT-2, and others.

The three sentence augmentation methods are listed as follows:

• Contextual Word Embeddings uses GPT-2, Distilled-GPT-2, and XLNet.
• Abstractive Summarization uses Facebook Robertaand T5-Large.
• Top-n Similar Word uses LAMBADA.

Before Pluto explains the code in the Python Notebook, let’s review the text augmentation libraries.