Installation of Hadoop
Now that we have seen both the storage and processing parts of a Hadoop cluster, let's get started with the installation of Hadoop. We will be using Hadoop 2.2.0 in this chapter. Please note that this version is not compatible with Hadoop 1.X versions.
We will be setting up a cluster on a single node. Before starting, please make sure that you have the following installed on your system:
- JDK 1.7
ssh-keygen
In case you don't have wget
or ssh-keygen
, install it with the following command:
# yum install openssh-clients
Next, we will need to set up a passwordless SSH on this machine as it is required for Hadoop.
Setting passwordless SSH
The following are the steps for setting up a passwordless SSH:
- Generate your SSH key pair by executing the following command:
$ ssh-keygen -t rsa -P ''Generating public/private rsa key pair.Enter file in which to save the key (/home/anand/.ssh/id_rsa): Your identification has been saved in /home/anand/.ssh/id_rsa.Your public key has been saved in...