Installing the environment

The environment focuses on open-source and free resources that we can run on our machine or a free Google Colab account. This chapter will run these resources on Google Colab with Hugging Face and Chroma.

We will first install Hugging Face.

Hugging Face

We will implement Hugging Face’s open-source resources to download a dataset for the Llama model. Sign up at https://huggingface.co/ to obtain your Hugging Face API token. If you are using Google Colab, you can create a Google Secret in the sidebar and activate it. If so, you can comment the following cell—# Save your Hugging Face token in a secure location:

#1.Uncomment the following lines if you want to use Google Drive to retrieve your token
from google.colab import drive
drive.mount('/content/drive')
f = open("drive/MyDrive/files/hf_token.txt", "r")
access_token=f.readline().strip()
f.close()
#2.Uncomment the following line if you want to enter...