Technical requirements
This chapter is largely theoretical, with a short code snippet in Python to illustrate the tiktoken
tokenizer library. To follow along, you will need access to a computer with Python version 3.8 or later.
To make the most of this chapter, you will need proficiency with Python and the pip
package manager. You will also need a basic knowledge of probabilities, calculus, and software development concepts such as APIs.