Running local LLMs
In this section, we will look at how you can download and run LLMs on your local computer.
Hugging Face
Hugging Face is a popular open-source platform for building and sharing state-of-the-art models in NLP. It is known for creating tools, libraries, and resources that democratize access to advanced machine-learning models. There are several areas where Hugging Face makes contributions to the LLM community:
- Transformers library: This provides a wide range of pretrained models for various NLP tasks, such as text generation, translation, summarization, and question-answering.
- Datasets library: This provides a vast collection of datasets ready for use in machine learning projects, covering a wide range of tasks and domains.
- Model hub: This is a platform where users can upload and share their own models with the community, browse and download models shared by others, and access tools for evaluating and benchmarking model performance. ...