Core components of YARN architecture

Here are some core components of YARN architecture that we need to know:

• ResourceManager
• ApplicationMaster
• NodeManager

ResourceManager

ResourceManager acts as a global resource scheduler that is responsible for resource management and scheduling as per the ApplicationMaster's requests for the resource requirements of the application(s). It is also responsible for the management of hierarchical job queues. The ResourceManager can be seen in the following figure:

The preceding diagram gives more details about the components of the ResourceManager. The Admin and Client service is responsible for client interactions, such as a job request submission, start, restart, and so on. The ApplicationsManager is responsible for the management of every application. The ApplicationMasterService interacts with every application. ApplicationMaster regarding resource or container negotiation, the ResourceTrackerService coordinates with the NodeManager and ResourceManager...