Programming MapReduce with Scalding: A practical guide to designing, testing, and implementing complex MapReduce applications in Scala

Antonios Chalkiopoulos

€11.99 ~~€17.99~~

4.3 (6 Ratings)

eBook Jun 2014 148 pages 1st Edition

Antonios Chalkiopoulos

€11.99 ~~€17.99~~

4.3 (6 Ratings)

eBook Jun 2014 148 pages 1st Edition

What do you get with eBook?

Instant access to your Digital eBook purchase

Download this book in EPUB and PDF formats

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

View table of contents

Preview Book

Description

This book is an easy-to-understand, practical guide to designing, testing, and implementing complex MapReduce applications in Scala using the Scalding framework. It is packed with examples featuring log-processing, ad-targeting, and machine learning. This book is for developers who are willing to discover how to effectively develop MapReduce applications. Prior knowledge of Hadoop or Scala is not required; however, investing some time on those topics would certainly be beneficial.

What you will learn

Set up an environment to execute jobs in local and Hadoop mode
Preview the complete Scalding API through examples and illustrations
Learn about Scalding capabilities, testing, and pipelining jobs
Understand the concepts of MapReduce patterns and the applications of its ecosystem
Implement logfile analysis and adtargeting applications using best practices
Apply a testdriven development (TDD) methodology and structure Scalding applications in a modular and testable way
Interact with external NoSQL and SQL data stores from Scalding
Deploy, schedule, monitor, and maintain production systems

What do you get with eBook?

Instant access to your Digital eBook purchase

Download this book in EPUB and PDF formats

Access this title in our online reader with advanced features

DRM FREE - Read whenever, wherever and however you want

Frequently bought together

€49.99

Learning Concurrent Programming in Scala

€36.99

€22.99

Total € 109.97

Filter reviews by

All

Amazon verified reviews

soulmachine Feb 23, 2015

This book is very easy to understand because it has many tiny examples that are very detailed to let you understand core APIs quickly.Chapter 4 "Intermediate Examples" elaborate two complete examples.Chapter 5 "Scalding Design Patterns" introduces three kind of desing paterns that are very pratical and insightful.The only weakness of this book is that it uses fields based APIs, but in my opinion, type safe APIs are more modern and elegant, however, all the knowlege of fiedls based APIs can apply to type safe APIs seeminglessly.

Amazon Verified review

Sujit Pal Jul 17, 2014

Scalding is a small but very powerful and expressive Scala DSL built on top of Cascading, itself a Java API that exposes relational algebra constructs that expand to Map and Reduce operators in the backend. Scalding was developed at Twitter and open sourced - it has reasonably good documentation on GitHub and support is available on their Google Groups mailing list. There is also Paco Nathan's Cascading book where Scalding gets a chapter. However, this is the first book devoted completely to Scalding, and it does a great job making the Scalding API accessible to a broader audience.The target audience for this book is someone who is somewhat familiar with Scala and Hadoop, though not necessarily an expert at either. The author describes the behavior of various Scalding operations using before and after diagrams on small datasets which I thought was very helpful in understanding the API. The book covers the original fields based API and the typed API, and finally the Matrix API, all through case examples that increase in complexity as more advanced features are explained. There is also some coverage on making Scalding work with various NoSQL databases using custom Taps rather than just files.I am not an expert at Scalding, but I have used it in the past so I was quite familiar with some features of the DSL. But having read this book, I have a much better idea of Scalding's capabilities and how I can use them.DISCLAIMER - I did not buy this book, I requested a copy from a PackT representative because I was interested in learning more about Scalding and thought this book may help (I was right), and I thought my perspective as someone somewhat familiar with Scalding would be useful for other readers.

Si Dunn Jul 29, 2014

Programming MapReduce with Scalding offers clear, well-illustrated, smoothly paced how-to steps, as well as easy-to-digest definitions and descriptions. It takes the reader from setting up and running a Hadoop mini-cluster and local-development environment to applying Scalding to real-use cases, as well as developing good test and test-driven development methodologies, running Scalding in production, using external data stores, and applying matrix calculations and machine learning.The book is written for developers who have at least "a basic understanding" of Hadoop and MapReduce, but is also intended for experienced Hadoop developers who may be "enlightened by this alternative methodology of developing MapReduce applications with Scalding."It does help to be somewhat familiar with MapReduce, Scalding, Scala, Hadoop, Maven, Eclipse and the Linux environment. But Antonio Chalkiopoulo does a good job of keeping the examples accessible even when readers are new to some of the packages.

Tushar Kapila Oct 28, 2015

few more examples with mixed join, how to refer to the elements in a fold, would be usful for everyday work

tom Oct 22, 2015

It's got good coverage and examples to get you descent with fields API, but missing a bit on explaining how the code would translate into mappers and reducers and what you should watch for to optimize your code. It's also out dated since people are using the typed API now.

Programming MapReduce with Scalding: A practical guide to designing, testing, and implementing complex MapReduce applications in Scala

What do you get with eBook?