Setting up the Storm cluster
In this chapter, we will learn how to set up a three nodes Storm cluster, of which one node will be the active master node (Nimbus) and the other two will be worker nodes (supervisors).
The following is the deployment diagram of our three node Storm cluster:
The following are the steps that need to be performed to set up a three node Storm cluster:
- Install and run the ZooKeeper cluster. The steps for installing ZooKeeper are mentioned in the previous section.
- Download the latest stable Storm release from https://storm.apache.org/downloads.html; at the time of writing, the latest version is Storm 1.0.2.
- Once you have downloaded the latest version, copy and unzip it in all three machines. Now, we will set the
$STORM_HOME
environment variable on each machine to make the setup easier. The$STORM_HOME
environment contains the path of the Stormhome
folder (for example, exportSTORM_HOME=/home/user/storm-1.0.2
). - Go to the
$STORM_HOME/conf
directory in the master nodes and...