Handling resource localization in YARN
Resource is anything that is required by the container to execute the assigned task. Since the containers are running and managed by NodeManager on different nodes, it is the responsibility of NodeManager to make the required resources available on every node. YARN facilitates this feature of NodeManager by providing ResourceLocalizationService. This service is responsible for downloading the application resource locally to the NodeManager node's filesystem and to make it available to containers running for that application.
Resource localization terminologies
In this section, we'll discuss a few terminologies related to resource localization in YARN. In order to configure and use resource localization, it is important to understand the following concepts:
LocalResource: It is defined as a resource required by the container for the execution of the application. NodeManager is responsible for making the resources available to the local filesystem before...
