Building and using the fine-tuned model
In this section, we will explore the process of creating and utilizing a fine-tuned model using OpenAI’s library in Python. OpenAI offers newcomers the opportunity to take advantage of a $5 credit to access the ChatGPT API and its fine-tuning services.
Fine-tuning involves building a specialized model based on an existing base model, and in our example, we will use the most advanced ChatGPT model available for fine-tuning, called gpt-3.5-turbo. We will improve the performance of that model for book summarization tasks.
We will learn how to start a fine-tuning job, which uploads and processes the training data, and then we’ll monitor its progress until completion. Once the fine-tuning job is done, we will use the newly created fine-tuned model to generate text. We’ll learn how to make requests to the fine-tuned model using the completions API, and then we’ll cover how to manage and delete fine-tuned models if...
