Real-time analytics using Elasticsearch and Apache Spark

We will use the same anomaly detection example from the previous chapter. Instead of using the simple k-means clustering library function provided by scikit-learn, we will use ES-Hadoop, Spark SQL, and Spark MLlib to solve the problem. From our GitHub download site (https://github.com/PacktPublishing/Mastering-Elasticsearch-7.0/tree/master/Chapter17/eshadoop), there is a project that involves using the Python 3.6 Virtual Environment (virtualenv) to create an isolated environment for the project to have its own dependencies in its site packages. The project is self-contained and allows you to run it on its working environment. The following section is a reference for you if you're interested in building a virtual environment.

...