Part 1: Fundamentals of Generative AI and GPT Models

In Part 1 of this book, the fundamentals of Generative AI and GPT models are introduced, including a brief history of the development of OpenAI and its flagship set of models, the GPT family.

This part starts with an overview of the domain of generative AI, providing you with foundation knowledge about this area of research of AI, including its history and state-of-the-art developments. You will also get familiar with the applications of generative AI, ranging from text generation to music composition.

Part 1 then introduces the company that brought the power of generative AI to the general public: OpenAI. You will get familiar with the technology behind OpenAI’s most popular release – ChatGPT – and understand the research journey that, starting from Artificial Neural Networks (ANNs), led to Large Language Models (LLMs).

This part has the following chapters:

• Chapter 1, Introduction to Generative...