Summary

In this chapter, we covered the installation and setup of Apache Hadoop. We started with the prerequisites for setting up a Hadoop cluster. We also went through different Hadoop configurations available for users, covering the development mode, pseudo distributed single nodes, and the cluster setup. We learned how each of these configurations can be set up, and we also ran an example application on the configurations. Finally, we covered how one can diagnose the Hadoop cluster by understanding the log files and different debugging tools available. In the next chapter, we will start looking at the Hadoop Distributed File System in detail.