Summary

In this last chapter, we saw more advanced probabilistic graphical models, whose solution is not easy to compute with standard tools such as the junction tree algorithm. This chapter set out to show that the graphical model framework can still be used even if one has to develop a special algorithm for each model. Indeed, in the LDA model, the solution to the variational problem appeared by looking at the graph of the original LDA and by transforming this graph, thus leading to a better approximation of the initial problem. So, even if the final algorithm does not use the graph directly like a junction tree algorithm would do, the solution came from the graph anyway.

This chapter proved how powerful probabilistic graphical models can be, and all the possibilities and new models that can be created from simpler models.

Indeed, each of these models can again be extended either by combining them—for example, in the mixture of experts model. In this model, each expert function could be...