Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Mastering Hadoop 3

You're reading from   Mastering Hadoop 3 Big data processing at scale to unlock unique business insights

Arrow left icon
Product type Paperback
Published in Feb 2019
Publisher Packt
ISBN-13 9781788620444
Length 544 pages
Edition 1st Edition
Languages
Tools
Concepts
Arrow right icon
Authors (3):
Arrow left icon
Timothy Wong Timothy Wong
Author Profile Icon Timothy Wong
Timothy Wong
Manish Kumar Manish Kumar
Author Profile Icon Manish Kumar
Manish Kumar
Chanchal Singh Chanchal Singh
Author Profile Icon Chanchal Singh
Chanchal Singh
Arrow right icon
View More author details
Toc

Table of Contents (21) Chapters Close

Preface 1. Section 1: Introduction to Hadoop 3 FREE CHAPTER
2. Journey to Hadoop 3 3. Deep Dive into the Hadoop Distributed File System 4. YARN Resource Management in Hadoop 5. Internals of MapReduce 6. Section 2: Hadoop Ecosystem
7. SQL on Hadoop 8. Real-Time Processing Engines 9. Widely Used Hadoop Ecosystem Components 10. Section 3: Hadoop in the Real World
11. Designing Applications in Hadoop 12. Real-Time Stream Processing in Hadoop 13. Machine Learning in Hadoop 14. Hadoop in the Cloud 15. Hadoop Cluster Profiling 16. Section 4: Securing Hadoop
17. Who Can Do What in Hadoop 18. Network and Data Security 19. Monitoring Hadoop 20. Other Books You May Enjoy

Fair scheduler

In fair scheduling, all applications get almost an equal amount of the available resources. In fair scheduler, when the first application is submitted to YARN, it will assign all the available resources to the application. Now in any scenario, if the new application is submitted to the scheduler, the scheduler will start allocating resources to the new application until both the applications have almost an equal amount of resources for their execution. Unlike the two schedulers discussed before, the fair scheduler prevents applications from resource starvation and assures that the applications in the queue get the required memory for execution. The distribution of the minimum and maximum share resources are calculated by the scheduling queue by using the configuration provided in the fair scheduler. The application will get the amount of resources configured...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $19.99/month. Cancel anytime