Introduction

Generative models are an exciting new branch of deep learning models that learn through unsupervised learning. The main idea is to generate new samples having the same distribution as the given training data; for example, a network trained on handwritten digits can create new digits that aren't in the dataset but are similar to them. Formally, we can say that if the training data follows the distribution P_data(x), then the goal of generative models is to estimate the probability density function P_model(x), which is similar to P_data(x).

Generative models can be classified into two types:

• Explicit generative models: Here, the probability density function P_model(x) is explicitly defined and solved. The density function may be tractable as in the case of PixelRNN/CNN, or an approximation of the density function as in the case of VAE.
• Implicit generative models...