Neural Network for Big Data

In the previous chapter, we established a basic foundation for our journey toward building intelligent systems. We differentiated the machine learning algorithms in two primary groups of supervised and unsupervised algorithms, and explored how the Spark programming model is a handy tool for us to implement these algorithms with a simple programming interface, along with a brief overview of the machine learning libraries available in Spark. We have also covered the fundamentals of regression analysis with a simple example and supporting code in Spark ML. The chapter showed how to cluster the data using the K-means algorithm and a deep dive into the realm of dimensionality reduction, which primarily helps us in representing the same information with fewer dimensions without any loss of information. We have formed the basis for the implementation of the...