Creating a Spark-enabled notebook

To use Spark in Watson Studio, you need to create a notebook and associate a Spark version with it by performing the following steps:

1. The steps to create the notebook are the same as we have followed in previous chapters. First, from within the project, locate the Notebook section and click on New Notebook. On the New notebook page, provide a name and description:

2. Notice that, in the preceding screenshot, Python 3.5 is the selected language—this is fine but then if we scroll down, we will see Spark version*. From the drop-down list, you can select the runtime environment for the notebook. For our example, we can select Default Spark Python 3.5 XS (Driver with 1 vCPU and 4GB, 2 executors with 1 vCPU and 4 GB RAM each):

3. Once you click on Create Notebook, the notebook environment will be instanced and you will be ready to begin entering...