Why introduce a public cloud?

At the beginning of this chapter, we saw how Microsoft and OpenAI have partnered in recent years and how Microsoft’s cloud, Azure, became the gym for OpenAI model training. However, it also became the cloud infrastructure where OpenAI models can be consumed.

But what is the difference between using models from OpenAI and Azure OpenAI? The difference is the underlying infrastructure: with Azure OpenAI, you are leveraging your own infrastructure while living in your own secured subscription. This brings a series of advantages:

• Scalability and flexibility: You can benefit from the scalability of Azure and accommodate the elastic usage of AOAI models. From small pilots to enterprise-level production projects, AOAI allows you to leverage the required capacity and scale up or down if necessary.
• Security and compliance: You can use role-based authentication and private network connectivity to make your deployment more secure and trusted...