Chapter 7. YARN Frameworks

It's the dawn of 2015, and big data is still in its booming stage. Many new start-ups and giants are investing a huge amount into developing POCs and new frameworks to cater to a new and emerging variety of problems. These frameworks are the new cutting-edge technologies or programming models that tend to solve the problems across industries in the world of big data. As the corporations are trying to use big data, they are facing a new and unique set of problems that they never faced before. Hence, to solve these new problems, many frameworks and programming models are coming onto the market.

YARN's support for multiple programming models and frameworks makes it ideal to be integrated with these new and emerging frameworks or programming models. With YARN taking responsibility for resource management and other necessary things (scheduling jobs, fault tolerance, and so on), it allows these new application frameworks to focus on solving the problems...