Since we can choose the embedding for each word, we might decide to change the weighting on certain words. One such strategy is to up weight useful words and downweight overly common or rare words. The embedding we will explore in this recipe is an attempt to achieve this.
Implementing TF-IDF
Getting ready
TF-IDF is an acronym that stands for Text Frequency - Inverse Document Frequency. This term is essentially the product of text frequency and inverse document frequency for each word.
In the preceding recipe, we introduced the bag-of-words methodology, which assigned a value of 1 for every occurrence of a word in a sentence. This is probably not ideal as each category of sentence (spam and ham in the preceding recipe&apos...
