Broadly speaking, machine learning models can be subdivided into discriminative models and generative models. Discriminative models learn a map from some input to some output. In discriminative models, learning the process that generates the input is not relevant; it will just learn a map from the to the expected output.
Generative models, on the other hand, in addition to learning a map from some input to some output, also learn the process that generates the input and the output.
![](https://static.packt-cdn.com/products/9781789538205/graphics/assets/244c15ff-94be-4353-b6fa-2c73056242df.png)
In this context, we say that discriminative models estimate : the conditional probability distribution of
conditioned on
. Note that, in this case, the input x is fixed, known a priori, and the discriminative model estimates the probability of
,
, but does not have any information...