In this section, we will present two simple examples of EMR clusters suitable for basic Spark development. In the first example, we will spin up an EMR cluster, start the Spark shell, and do some Spark-Scala work. In the second example, we will spin up an EMR cluster and run a simple Spark program.
Follow the step-by-step instructions specified next for this hands-on exercise:
- Log in to the AWS Management Console and open the Amazon EMR console and click on the Create cluster button:
- We will use the Create Cluster - Quick Options for selecting the options for our cluster. Specify a name for the cluster (FirstEMRSparkClusterUsingQuickOptions). Choose Launch mode as Cluster:
In the Software configuration section, ensure you have selected the latest available version of EMR and select the Spark option:
Leave the defaults for Hardware...