Chapter 3. Setting Up a Secured Hadoop Cluster

In Chapter 2, Hadoop Security Design, we looked at the internals of Hadoop security design and enabled ourselves to set up a secured Hadoop cluster. In this chapter, we will look at how to set up a Kerberos authentication and then get into the details of how to set up and configure a secure Hadoop cluster.

To set up a secured Hadoop cluster, we need to set up Kerberos authentication on the nodes. Kerberos authentication requires reverse DNS lookup to work on all the nodes as it uses the hostname to resolve the principal name. Once Kerberos is installed and configured, we set up the Hadoop service principals and all user principals. After that, we update the Hadoop configurations to enable Kerberos authentication on all nodes and start the Hadoop cluster.

These are the topics we'll be covering in this chapter:

• Prerequisites for setting up a secure Hadoop cluster

• Setting up Kerberos

• Configuring Hadoop with Kerberos authentication

• Configuring Hadoop...