Chapter 8, Matching Tokenizers and Datasets

1. A tokenized dictionary contains every word that exists in a language. (True/False)

   False.

2. Pretrained tokenizers can encode any dataset. (True/False)

   False.

3. It is good practice to check a database before using it. (True/False)

   True.

4. It is good practice to eliminate obscene data from datasets. (True/False)

   True.

5. It is a good practice to delete data containing discriminating assertions. (True/False)

   True.

6. Raw datasets might sometimes produce relationships between noisy content and useful content. (True/False)

   True.

7. A standard pretrained tokenizer contains the English vocabulary of the past 700 years. (True/False)

   False.

8. Old English can create problems when encoding data with a tokenizer trained in modern English. (True/False)

   True.

9. Medical and other types of jargon can create problems when encoding data with a tokenizer trained in modern English...