Summary

In this chapter, we introduced SparkR. We covered SparkR architecture and SparkR DataFrames API. Additionally, we provided code examples for using SparkR for EDA and data munging tasks, data visualization, and machine learning.

In the next chapter, we will build Spark applications using a mix of Spark modules. We will present examples of applications that combine Spark SQL with Spark Streaming, Spark Machine Learning, and so on.