Conventions used

There are a number of text conventions used throughout this book.

Code in text: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: “ Here, the given tokens are [“the”, “recent”, “advance”, “ments”, “in”, ...].

The vocabulary is {“the”: 0, “recent”: 1, “advance”: 2, “ments”: 3, “in”: 4, ...}”

A block of code is set as follows:

CREATE TABLE llm_token_data (
    token_id bigint,
    token text,
    frequency bigint,
    document_ids list<bigint>,
    PRIMARY KEY (token_id)
);

Bold: Indicates a new term, an important word, or words that you see onscreen. For instance, words in menus or dialog boxes appear in bold. Here is an example: “…and exploring the Question Answering benchmarks and datasets.”

Tips or important notes

Appear like this.