Sentence Classification in FastText

In this chapter, we will cover the following topics:

• Sentence classification
• fastText supervised learning:
  • Architecture
  • Hierarchical softmax architecture
  • N-grams features and the hashing trick:
    • The Fowler-Noll-Vo (FNV) hash
  • Word embeddings and their use in sentence classification
• fastText model quantization:
  • Compression:
    • Quantization
    • Vector quantization:
      • Finding the codebook for high-dimensional spaces
    • Product quantization
    • Additional steps