Part 2: Configure Your Environment
In part 2, you’ll learn how to configure your environment for large-scale pretraining. We’ll dive into graphics processing units (GPUs), parallelization basics, and the second part of dataset preparation.
This section has the following chapters:
- Chapter 4, Containers and Accelerators on the Cloud
- Chapter 5, Distribution Fundamentals
- Chapter 6, Dataset Preparation: Part Two, the Data Loader