Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Apache Mahout Essentials
Apache Mahout Essentials

Apache Mahout Essentials: Implement top-notch machine learning algorithms for classification, clustering, and recommendations with Apache Mahout

eBook
AU$20.98 AU$29.99
Paperback
AU$37.99
Subscription
Free Trial
Renews at AU$24.99p/m

What do you get with eBook?

Product feature icon Instant access to your Digital eBook purchase
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Billing Address

Table of content icon View table of contents Preview book icon Preview Book

Apache Mahout Essentials

Chapter 1. Introducing Apache Mahout

As you may be already aware, Apache Mahout is an open source library of scalable machine learning algorithms that focuses on clustering, classification, and recommendations.

This chapter will provide an introduction to machine learning and Apache Mahout.

In this chapter, we will cover the following topics:

  • Machine learning in a nutshell
  • Machine learning applications
  • Machine learning libraries
  • The history of machine learning
  • Apache Mahout
  • Setting up Apache Mahout
  • How Apache Mahout works
  • From Hadoop MapReduce to Spark
  • When is it appropriate to use Apache Mahout?

Machine learning in a nutshell

 

"Machine learning is the most exciting field of all the computer sciences. Sometimes I actually think that machine learning is not only the most exciting thing in computer science, but also the most exciting thing in all of human endeavor."

 
 --Andrew Ng, Associate Professor at Stanford and Chief Scientist of Baidu

Giving a detailed explanation of machine learning is beyond the scope of this book. For this purpose, there are other excellent resources that I have listed here:

  • Machine Learning by Andrew Ng at Coursera (https://www.coursera.org/course/ml)
  • Foundations of Machine Learning (Adaptive Computation and Machine Learning series) by Mehryar Mohri, Afshin Rostamizadeh, and Ameet Talwalker

However, basic machine learning concepts are explained very briefly here, for those who are not familiar with it.

Machine learning is an area of artificial intelligence that focuses on learning from the available data to make predictions on unseen data without explicit programming.

To solve real-world problems using machine learning, we first need to represent the characteristics of the problem domain using features.

Features

A feature is a distinct, measurable, heuristic property of the item of interest being perceived. We need to consider the features that have the greatest potential in discriminating between different categories.

Supervised learning versus unsupervised learning

Let's explain the difference between supervised learning and unsupervised learning using a simple example of pebbles:

Supervised learning versus unsupervised learning
  • Supervised learning: Take a collection of mixed pebbles, as given in the preceding figure, and categorize (label) them as small, medium, and large pebbles. Examples of supervised learning are regression and classification.
  • Unsupervised learning: Here, just group them based on similar sizes but don't label them. An example of unsupervised learning is clustering.

For a machine to perform learning tasks, it requires features such as the diameter and weight of each pebble.

This book will cover how to implement the following machine learning techniques using Apache Mahout:

  • Clustering
  • Classification and regression
  • Recommendations

Machine learning applications

Do you know that machine learning has a significant impact in real-life day-to-day applications? World's popular organizations, such as Google, Facebook, Yahoo!, and Amazon, use machine learning algorithms in their applications.

Information retrieval

Information retrieval is an area where machine learning is vastly applied in the industry. Some examples include Google News, Google target advertisements, and Amazon product recommendations.

Google News uses machine learning to categorize large volumes of online news articlesL:

Information retrieval

The relevance of Google target advertisements can be improved by using machine learning:

Information retrieval

Amazon as well as most of the e-business websites use machine learning to understand which products will interest the users:

Information retrieval

Even though information retrieval is the area that has commercialized most of the machine learning applications, machine learning can be applied in various other areas, such as business and health care.

Business

Machine learning is applied to solve different business problems, such as market segmentation, business analytics, risk classification, and stock market predictions.

A few of them are explained here.

Market segmentation (clustering)

In market segmentation, clustering techniques can be used to identify the homogeneous subsets of consumers, as shown in the following figure:

Market segmentation (clustering)

Take an example of a Fast-Moving Consumer Goods (FMCG) company that introduces a shampoo for personal use. They can use clustering to identify the different market segments, by considering features such as the number of people who have hair fall, colored hair, dry hair, and normal hair. Then, they can decide on the types of shampoo required for different market segments, which will maximize the profit.

Stock market predictions (regression)

Regression techniques can be used to predict future trends in stocks by considering features such as closing prices and foreign currency rates.

Health care

Machine learning is heavily used in medical image processing in the health care sector. Using a mammogram for cancer tissue detection is one example of this.

Using a mammogram for cancer tissue detection

Classification techniques can be used for the early detection of breast cancers by analyzing the mammograms with image processing, as shown in the following figure, which is a difficult task for humans due to irregular pathological structures and noise.

Using a mammogram for cancer tissue detection

Machine learning libraries

Machine learning libraries can be categorized using different criteria, which are explained in the sections that follow.

Open source or commercial

Free and open source libraries are cost-effective solutions, and most of them provide a framework that allows you to implement new algorithms on your own. However, support for these libraries is not as good as the support available for proprietary libraries. However, some open source libraries have very active mailing lists to address this issue.

Apache Mahout, OpenCV, MLib, and Mallet are some open source libraries.

MATLAB is a commercial numerical environment that contains a machine learning library.

Scalability

Machine learning algorithms are resource-intensive (CPU, memory, and storage) operations. Also, most of the time, they are applied on large volumes of datasets. So, decentralization (for example, data and algorithms), distribution, and replication techniques are used to scale out a system:

  • Apache Mahout (data distributed over clusters and parallel algorithms)
  • Spark MLib (distributed memory-based Spark architecture)
  • MLPACK (low memory or CPU requirements due to the use of C++)
  • GraphLab (multicore parallelism)

Languages used

Most of the machine learning libraries are implemented using languages such as Java, C#, C++, Python, and Scala.

Algorithm support

Machine learning libraries, such as R and Weka, have many machine learning algorithms implemented. However, they are not scalable. So, when it comes to scalable machine learning libraries, Apache Mahout has better algorithm support than Spark MLib at the moment, as Spark MLib is relatively young.

Batch processing versus stream processing

Stream processing mechanisms, for example, Jubatus and Samoa, update a model instantaneously just after receiving data using incremental learning.

In batch processing, data is collected over a period of time and then processed together. In the context of machine learning, the model is updated after collecting data for a period of time. The batch processing mechanism (for example, Apache Mahout) is mostly suitable for processing large volumes of data.

LIBSVM implements support vector machines and it is specialized for that purpose.

A comparison of some of the popular machine learning libraries is given in the following table Table 1: Comparison between popular machine learning libraries:

Machine learning library

Open source or commercial

Scalable?

Language used

Algorithm support

MATLAB

Commercial

No

Mostly C

High

R packages

Open source

No

R

High

Weka

Open source

No

Java

High

Sci-Kit Learn

Open source

No

Python

 

Apache Mahout

Open source

Yes

Java

Medium

Spark MLib

Open source

Yes

Scala

Low

Samoa

Open source

Yes

Java

 

The story so far

The following timeline will give you an idea about the way machine learning has evolved and the maturity of the available machine learning libraries. Also, it is evident that even though machine learning was found in 1952, popular machine learning libraries have begun to evolve very recently.

The story so far

Apache Mahout

In this section, we will have a quick look at Apache Mahout.

Do you know how Mahout got its name?

Apache Mahout

As you can see in the logo, a mahout is a person who drives an elephant. Hadoop's logo is an elephant. So, this is an indicator that Mahout's goal is to use Hadoop in the right manner.

The following are the features of Mahout:

  • It is a project of the Apache software foundation
  • It is a scalable machine learning library
    • The MapReduce implementation scales linearly with the data
    • Fast sequential algorithms (the runtime does not depend on the size of the dataset)
  • It mainly contains clustering, classification, and recommendation (collaborative filtering) algorithms
  • Here, machine learning algorithms can be executed in sequential (in-memory mode) or distributed mode (MapReduce is enabled)
  • Most of the algorithms are implemented using the MapReduce paradigm
  • It runs on top of the Hadoop framework for scaling
  • Data is stored in HDFS (data storage) or in memory
  • It is a Java library (no user interface!)
  • The latest released version is 0.9, and 1.0 is coming soon
  • It is not a domain-specific but a general purpose library

Note

For those of you who are curious! What are the problems that Mahout is trying to solve? The following problems that Mahout is trying to solve:

The amount of available data is growing drastically.

The computer hardware market is geared toward providing better performance in computers. Machine learning algorithms are computationally expensive algorithms. However, there was no framework sufficient to harness the power of hardware (multicore computers) to gain better performance.

The need for a parallel programming framework to speed up machine learning algorithms.

Mahout is a general parallelization for machine learning algorithms (the parallelization method is not algorithm-specific).

No specialized optimizations are required to improve the performance of each algorithm; you just need to add some more cores.

Linear speed up with number of cores.

Each algorithm, such as Naïve Bayes, K-Means, and Expectation-maximization, is expressed in the summation form. (I will explain this in detail in future chapters.)

For more information, please read Map-Reduce for Machine Learning on Multicore, which can be found at http://www.cs.stanford.edu/people/ang/papers/nips06-mapreducemulticore.pdf.

Setting up Apache Mahout

Download the latest release of Mahout from https://mahout.apache.org/general/downloads.html.

If you are referencing Mahout as a Maven project, add the following dependency in the pom.xml file:

<dependency>
  <groupId>org.apache.mahout</groupId>
  <artifactId>mahout-core</artifactId>
  <version>${mahout.version}</version>
</dependency>

If required, add the following Maven dependencies as well:

<dependency>
  <groupId>org.apache.mahout</groupId>
  <artifactId>mahout-math</artifactId>
  <version>${mahout.version}</version>
</dependency>
<dependency>
  <groupId>org.apache.mahout</groupId>
  <artifactId>mahout-integration</artifactId>
  <version>${mahout.version}</version>
</dependency>

Tip

Downloading the example code

You can download the example code files from your account at http://www.packtpub.com for all the Packt Publishing books you have purchased. If you purchased this book elsewhere, you can visit http://www.packtpub.com/support and register to have the files e-mailed directly to you.

More details on setting up a Maven project can be found at http://maven.apache.org/.

Follow the instructions given at https://mahout.apache.org/developers/buildingmahout.html to build Mahout from the source.

The Mahout command-line launcher is located at bin/mahout.

How Apache Mahout works?

Let's take a look at the various components of Mahout.

The high-level design

The following table represents the high-level design of a Mahout implementation. Machine learning applications access the API, which provides support for implementing different machine learning techniques, such as clustering, classification, and recommendations.

Also, if the application requires preprocessing (for example, stop word removal and stemming) for text input, it can be achieved with Apache Lucene. Apache Hadoop provides data processing and storage to enable scalable processing.

Also, there will be performance optimizations using Java Collections and the Mahout-Math library. The Mahout-integration library contains utilities such as displaying the data and results.

The high-level design

The distribution

MapReduce is a programming paradigm to enable parallel processing. When it is applied to machine learning, we assign one MapReduce engine to one algorithm (for each MapReduce engine, one master is assigned).

Input is provided as Hadoop sequence files, which consist of binary key-value pairs. The master node manages the mappers and reducers. Once the input is represented as sequence files and sent to the master, it splits data and assigns the data to different mappers, which are other nodes. Then, it collects the intermediate outcome from mappers and sends them to related reducers for further processing. Lastly, the final outcome is generated.

From Hadoop MapReduce to Spark

Let's take a look at the journey from MapReduce to Spark.

Problems with Hadoop MapReduce

Even though MapReduce provides a suitable programming model for batch data processing, it does not perform well with real-time data processing. When it comes to iterative machine learning algorithms, it is necessary to carry information across iterations. Moreover, an intermediate outcome needs to be persisted during each iteration. Therefore, it is necessary to store and retrieve temporary data from the Hadoop Distributed File System (HDFS) very frequently, which incurs significant performance degradation.

Machine learning algorithms that can be written in a certain form of summation (algorithms that fit in the statistical query model) can be implemented in the MapReduce programming model. However, some of the machine learning algorithms are hard to implement by adhering to the MapReduce programming paradigm. MapReduce cannot be applied if there are any computational dependencies between the data.

Therefore, this constrained programming model is a barrier for Apache Mahout as it can limit the number of supported distributed algorithms.

In-memory data processing with Spark and H2O

Apache Spark is a large-scale scalable data processing framework, which claims to be 100 times faster than Hadoop MapReduce when in memory and 10 times faster in disk, has a distributed memory-based architecture. H2O is an open source, parallel processing engine for machine learning by 0xdata.

As a solution to the problems of the Hadoop MapReduce approach mentioned previously, Apache Mahout is working on integrating Apache Spark and H2O as the backend integration (with the Mahout Math library).

Why is Mahout shifting from Hadoop MapReduce to Spark?

With Spark, there can be better support for iterative machine learning algorithms using the in-memory approach. In-memory applications are self-optimizing. An algebraic expression optimizer is used for distributed linear algebra. One significant example is the Distributed Row Matrix (DRM), which is a huge matrix partitioned by rows.

Further, programming with Spark is easier than programming with MapReduce because Spark decouples the machine learning logic from the distributed backend. Accordingly, the distribution is hidden from the machine learning API users. This can be used like R or MATLAB.

When is it appropriate to use Apache Mahout?

You should consider the following aspects before making a decision to use Apache Mahout as your machine learning library:

  • Are you looking for a machine learning algorithm for industry use with performance as a critical evaluation factor?
  • Are you looking for a free and open source solution?
  • Is your dataset large and growing at an alarming rate? (MATLAB, Weka, Octave, and R can be used to process KBs and MBs of data, but if your data volume is growing up to the GB level, then it is better to use Mahout.)
  • Do you want batch data processing as opposed to real-time data processing?
  • Are you looking for a mature library, which has been there in the market for a few years?

If all or most of the preceding considerations are met, then Mahout is the right solution for you.

Summary

Machine learning is about discovering hidden insights or patterns from the available data. Machine learning algorithms can be divided in two categories: supervised learning and unsupervised learning. There are many real-world applications of machine learning in diverse domains, such as information retrieval, business, and health care.

Apache Mahout is a scalable machine learning library that runs on top of the Hadoop framework. In v0.10, Apache Mahout is shifting toward Apache Spark and H20 to address performance and usability issues that occur due to the MapReduce programming paradigm.

In the upcoming chapters, we will dive deep into different machine learning techniques.

Left arrow icon Right arrow icon

Description

If you are a Java developer or data scientist, haven't worked with Apache Mahout before, and want to get up to speed on implementing machine learning on big data, then this is the perfect guide for you.

What you will learn

  • Get started with the fundamentals of Big Data, batch, and realtime data processing with an introduction to Mahout and its applications
  • Understand the key machine learning concepts behind algorithms in Apache Mahout
  • Apply machine learning algorithms provided by Apache Mahout in realworld practical scenarios
  • Implement and evaluate widelyused clustering, classification, and recommendation algorithms using Apache Mahout
  • Discover tips and tricks to improve the accuracy and performance of your results
  • Set up Apache Mahout in a production environment with Apache Hadoop
  • Glance at the Spark DSL advancements in Apache Mahout 1.0
  • Provide dynamic and interactive data visualizations for Apache Mahout
  • Build a recommendation engine for realtime use cases and use userbased and itembased recommendation algorithms

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Jun 19, 2015
Length: 164 pages
Edition : 1st
Language : English
ISBN-13 : 9781783555000
Vendor :
Apache
Category :
Languages :
Tools :

What do you get with eBook?

Product feature icon Instant access to your Digital eBook purchase
Product feature icon Download this book in EPUB and PDF formats
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Billing Address

Product Details

Publication date : Jun 19, 2015
Length: 164 pages
Edition : 1st
Language : English
ISBN-13 : 9781783555000
Vendor :
Apache
Category :
Languages :
Tools :

Packt Subscriptions

See our plans and pricing
Modal Close icon
AU$24.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
AU$249.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just AU$5 each
Feature tick icon Exclusive print discounts
AU$349.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just AU$5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total AU$ 105.98
Spark Cookbook
AU$67.99
Apache Mahout Essentials
AU$37.99
Total AU$ 105.98 Stars icon

Table of Contents

7 Chapters
1. Introducing Apache Mahout Chevron down icon Chevron up icon
2. Clustering Chevron down icon Chevron up icon
3. Regression and Classification Chevron down icon Chevron up icon
4. Recommendations Chevron down icon Chevron up icon
5. Apache Mahout in Production Chevron down icon Chevron up icon
6. Visualization Chevron down icon Chevron up icon
Index Chevron down icon Chevron up icon

Customer reviews

Rating distribution
Full star icon Full star icon Full star icon Half star icon Empty star icon 3.7
(3 Ratings)
5 star 33.3%
4 star 0%
3 star 66.7%
2 star 0%
1 star 0%
Thimira Amaratunga Aug 17, 2015
Full star icon Full star icon Full star icon Full star icon Full star icon 5
This book provides a great starting point for everyone wanting to get in to Apache Mahout and interested in machine learning alike. I really like the way the author has explained many of the machine learning concepts without over-complicating them, which makes this a good book for any machine learning enthusiast. The step-by-step explanations make anyone try it out hands on to learn.
Amazon Verified review Amazon
Client d'Amazon Sep 08, 2016
Full star icon Full star icon Full star icon Empty star icon Empty star icon 3
Medium book! Not very detailed!
Amazon Verified review Amazon
Pablo Torre Rodriguez Jul 23, 2015
Full star icon Full star icon Full star icon Empty star icon Empty star icon 3
I purchased this book and I think is a good book for those guys want to start to learn about Apache Mahout. This book provides some interesting sample code about Clustering and Recommendations. But if you want to specialize in Apache Mahout you should read Mahout in Action. For me is the best book that you can purchase about Mahout.
Amazon Verified review Amazon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

How do I buy and download an eBook? Chevron down icon Chevron up icon

Where there is an eBook version of a title available, you can buy it from the book details for that title. Add either the standalone eBook or the eBook and print book bundle to your shopping cart. Your eBook will show in your cart as a product on its own. After completing checkout and payment in the normal way, you will receive your receipt on the screen containing a link to a personalised PDF download file. This link will remain active for 30 days. You can download backup copies of the file by logging in to your account at any time.

If you already have Adobe reader installed, then clicking on the link will download and open the PDF file directly. If you don't, then save the PDF file on your machine and download the Reader to view it.

Please Note: Packt eBooks are non-returnable and non-refundable.

Packt eBook and Licensing When you buy an eBook from Packt Publishing, completing your purchase means you accept the terms of our licence agreement. Please read the full text of the agreement. In it we have tried to balance the need for the ebook to be usable for you the reader with our needs to protect the rights of us as Publishers and of our authors. In summary, the agreement says:

  • You may make copies of your eBook for your own use onto any machine
  • You may not pass copies of the eBook on to anyone else
How can I make a purchase on your website? Chevron down icon Chevron up icon

If you want to purchase a video course, eBook or Bundle (Print+eBook) please follow below steps:

  1. Register on our website using your email address and the password.
  2. Search for the title by name or ISBN using the search option.
  3. Select the title you want to purchase.
  4. Choose the format you wish to purchase the title in; if you order the Print Book, you get a free eBook copy of the same title. 
  5. Proceed with the checkout process (payment to be made using Credit Card, Debit Cart, or PayPal)
Where can I access support around an eBook? Chevron down icon Chevron up icon
  • If you experience a problem with using or installing Adobe Reader, the contact Adobe directly.
  • To view the errata for the book, see www.packtpub.com/support and view the pages for the title you have.
  • To view your account details or to download a new copy of the book go to www.packtpub.com/account
  • To contact us directly if a problem is not resolved, use www.packtpub.com/contact-us
What eBook formats do Packt support? Chevron down icon Chevron up icon

Our eBooks are currently available in a variety of formats such as PDF and ePubs. In the future, this may well change with trends and development in technology, but please note that our PDFs are not Adobe eBook Reader format, which has greater restrictions on security.

You will need to use Adobe Reader v9 or later in order to read Packt's PDF eBooks.

What are the benefits of eBooks? Chevron down icon Chevron up icon
  • You can get the information you need immediately
  • You can easily take them with you on a laptop
  • You can download them an unlimited number of times
  • You can print them out
  • They are copy-paste enabled
  • They are searchable
  • There is no password protection
  • They are lower price than print
  • They save resources and space
What is an eBook? Chevron down icon Chevron up icon

Packt eBooks are a complete electronic version of the print edition, available in PDF and ePub formats. Every piece of content down to the page numbering is the same. Because we save the costs of printing and shipping the book to you, we are able to offer eBooks at a lower cost than print editions.

When you have purchased an eBook, simply login to your account and click on the link in Your Download Area. We recommend you saving the file to your hard drive before opening it.

For optimal viewing of our eBooks, we recommend you download and install the free Adobe Reader version 9.