Fair Scheduler pools
In this recipe, we look at configuring Fair Scheduler with pools instead of queues. This is for backwards compatibility. In Hadoop 1.X, Fair Scheduler was addressed with pools and it means the same as queues.
It is recommended to use queues, as this is quite standard across the board. But, for the sake of the readers, it is good to cover the concepts of pools.
Getting ready
To go through the recipe, complete the previous recipe and just modify the fair-scheduler.xml file to reflect pools.
How to do it...
Connect to the
master1.cyrus.commaster node in the cluster and switch as userhadoop.Edit the allocation file
fair-scheduler.xml, as shown in the following screenshot:
Copy the
fair-scheduler.xmlfile to all the nodes in the cluster and restart the YARN daemons.Check the ResourceManager page to confirm whether the pools are visible or not, as shown in the following screenshot:
Submit a sample job such as
wordcountas userhadoopand see the ResourceManager page, as shown in...
