One of the most common problems in NLP and topic modeling is represented by the semantic-free structure of the Bag-of-Words strategy. In fact, as discussed in the previous chapter, Chapter 13, Introducing Natural Language Processing, this strategy is based on frequency counts and doesn't take into account the positions and the similarity of the tokens. The problem can be partially mitigated by employing n-grams; however, it's still impossible to detect the contextual similarity of words. For example, let's suppose that a corpus contains the sentences John lives in Paris and Mark lives in Rome. If we perform a Part-of-Speech (POS) and Named Entity Recognition (NER) tagging, we can discover that John and Mark are proper nouns and Paris and Rome are cities. Hence, we can deduce that the two sentences share the same structure; Paris...
United States
Great Britain
India
Germany
France
Canada
Russia
Spain
Brazil
Australia
Singapore
Hungary
Ukraine
Luxembourg
Estonia
Lithuania
South Korea
Turkey
Switzerland
Colombia
Taiwan
Chile
Norway
Ecuador
Indonesia
New Zealand
Cyprus
Denmark
Finland
Poland
Malta
Czechia
Austria
Sweden
Italy
Egypt
Belgium
Portugal
Slovenia
Ireland
Romania
Greece
Argentina
Netherlands
Bulgaria
Latvia
South Africa
Malaysia
Japan
Slovakia
Philippines
Mexico
Thailand