Hands-on NLP with Spark

In this section, some examples of the implementation of NLP (and its core concepts as described in the previous sections) with Apache Spark are going to be detailed. These examples don't include DL4J or other DL frameworks, as NLP with multilayer neural networks will be the main topic of the next chapter.

While one of the core components of Spark, MLLib, is an ML library, it doesn't provide any facility for NLP. So, you need to use some other NLP library or framework on top of Spark.

Hands-on NLP with Spark and Stanford core NLP

The first example covered in this chapter involves a Scala Spark wrapper of the Stanford core NLP (https://github.com/stanfordnlp/CoreNLP) library, which is open source...