Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
YARN Essentials

You're reading from   YARN Essentials A comprehensive, hands-on guide to install, administer, and configure settings in YARN

Arrow left icon
Product type Paperback
Published in Feb 2015
Publisher
ISBN-13 9781784391737
Length 176 pages
Edition 1st Edition
Tools
Arrow right icon
Toc

Table of Contents (12) Chapters Close

Preface 1. Need for YARN FREE CHAPTER 2. YARN Architecture 3. YARN Installation 4. YARN and Hadoop Ecosystems 5. YARN Administration 6. Developing and Running a Simple YARN Application 7. YARN Frameworks 8. Failures in YARN 9. YARN – Alternative Solutions 10. YARN – Future and Support Index

MRv1 versus MRv2


MRv1 (MapReduce version 1) is part of Apache Hadoop 1.x and is an implementation of the MapReduce programming paradigm.

The MapReduce project itself can be broken into the following parts:

  • End-user MapReduce API: This is the API needed to develop the MapReduce application.

  • MapReduce framework: This is the runtime implementation of various phases, such as the map phase, the sort/shuffle/merge aggregation phase, and the reduce phase.

  • MapReduce system: This is the backend infrastructure required to run MapReduce applications and includes things such as cluster resource management, scheduling of jobs, and so on.

Hadoop 1.x was written solely as an MR engine. Since it runs on a cluster, its cluster management component was also tightly coupled with the MR programming paradigm. The only thing that could be run on Hadoop 1.x was an MR job.

In MRv1, the cluster was managed by a single JobTracker and multiple TaskTrackers running on the DataNodes.

In Hadoop 2.x, the old MRv1 framework...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at R$50/month. Cancel anytime