Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
YARN Essentials

You're reading from   YARN Essentials A comprehensive, hands-on guide to install, administer, and configure settings in YARN

Arrow left icon
Product type Paperback
Published in Feb 2015
Publisher
ISBN-13 9781784391737
Length 176 pages
Edition 1st Edition
Tools
Arrow right icon
Toc

Table of Contents (12) Chapters Close

Preface 1. Need for YARN FREE CHAPTER 2. YARN Architecture 3. YARN Installation 4. YARN and Hadoop Ecosystems 5. YARN Administration 6. Developing and Running a Simple YARN Application 7. YARN Frameworks 8. Failures in YARN 9. YARN – Alternative Solutions 10. YARN – Future and Support Index

YARN scheduling policies


The YARN architecture has pluggable scheduling policies that depend on the application's requirements and the use case defined for the running application. You can find the YARN scheduling configurations in the yarn-site.xml file. Here, you can specify the scheduling system as either FIFO, capacity, or fair scheduling as per the application's needs. You can also find the running application scheduling information in the ResourceManager UI. Many components of the scheduling system are defined briefly there.

As already mentioned, there are three type of scheduling policies that the YARN scheduler follows:

  • FIFO scheduler

  • Capacity scheduler

  • Fair scheduler

The FIFO (First In First Out) scheduler

This is the scheduling policy introduced into the system from Hadoop 1.0. The JobTracker was used to be FIFO scheduling policies. As the name indicates, FIFO means First in First Out, that is, the job submitted first will execute first. The FIFO scheduler policy does not follow any...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €18.99/month. Cancel anytime