YARN multitenancy application support

YARN comes with built-in multitenancy support. Now, let's have a look at what multitenancy means. Consider a society that has multiple apartments in it, so there are different types of family living in different apartments with security and privacy, but they all share the society's common areas, such as the society gate, garden, play area, and other amenities. Their apartments also share common walls. The same concept is followed in YARN: the that run running into the cluster share the cluster resources in a multitenant way. They share cluster processing capacity, cluster storage capacity, data access securities, and so on. Multitenancy is achieved in the cluster by differentiating applications into multiple business units, for example, different queues and users for different types of applications.

Security and privacy can be achieved by configuring Linux and HDFS permissions to separate files and directories to create tenant boundaries. This can be...