Configuring Spark

Apache Spark can be configured in the following modes:

• Standalone mode
• Distributed or cluster mode

Prerequisites

The following are the prerequisites that are required for configuring Spark in any of the modes:

• Linux OS: Spark is most compatible with any flavor of the Linux operating system. You can use any desktop, virtual machine, server, or a cloud-scale machine to install Spark. Although you can install it on your Windows machine, we are using the Ubuntu AWS machine for configuring Spark.

• Scala/Python/Java: Spark supports APIs in multiple languages including Scala, Python, and Java. All Spark actions and transformations APIs are available in these different languages.

...