Code lab 7.1 – Common vectorization techniques
Vectorization algorithms have evolved significantly over the past few decades. Understanding how these have changed, and why, will help you gain more perspective on how to choose the one that fits your needs the most. Let’s walk through some of these vectorization algorithms, starting with some of the earliest ones and ending with the most recent, more advanced options. This is nowhere close to an exhaustive list, but these select few should be enough to give you a sense of where this part of the field came from and where it is going. Before we start, let’s install and import some new Python packages that play important roles in our coding journey through vectorization techniques:
%pip install gensim --user %pip install transformers %pip install torch
This code should go near the top of the previous code in the same cell as the other package installations.