LDA Visualization
Topic modeling classifies a large volume of corpora into topics, and each topic has a set of distinct words. It produces very rich information for each topic. The next challenge is how to present the rich information. This challenge is a research topic in the development of NLP.
The good news is that several visual tools have provided the solution, including pyLDAvis, which we will cover in this chapter. We will first discuss the gap between hard topic modeling and soft human comprehension. Then we will learn how to use pyLDAvis.
We will cover the following topics:
- Designing an infographic
- Data visualization with pyLDAvis
By the end of this chapter, you will be able to visualize an LDA model using interactive infographics to explain model insights. The design of pyLDAvis infographics has even influenced the visualization of BERTopic model outcomes, which we will practice in Chapter 14, LDA and BERTopic.
