Subscription

Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Learning Hub

Conferences

Free Learning

You're reading from Apache Spark 2.x for Java Developers Explore big data at scale using Apache Spark 2.x Java APIs

Product type Paperback

Published in Jul 2017

Publisher Packt

ISBN-13 9781787126497

Length 350 pages

Edition 1st Edition

Languages

Java

Tools

Apache Spark

Concepts

Big Data

Authors (2):

Sourav Gulati

Sumit Kumar

View More author details

Table of Contents (12) Chapters

Preface

1. Introduction to Spark FREE CHAPTER

2. Revisiting Java

3. Let Us Spark

4. Understanding the Spark Programming Model

5. Working with Data and Storage

6. Spark on Cluster

7. Spark Programming Model - Advanced

8. Working with Spark SQL

9. Near Real-Time Processing with Spark Streaming

10. Machine Learning Analytics with Spark MLlib

11. Learning Spark GraphX

Spark Programming Model - Advanced

In the previous chapter, we discussed how Spark components get deployed on the cluster. It's now time to learn about the advanced concepts of the Spark programming model.

We will talk about the how RDD gets partitioned across the cluster, and some advanced transformations and actions that can be performed on an RDD. We will also discuss cluster-wide variables that can be accessed by various tasks being executed on different executors that are running on different worker nodes.

The rest of the chapter is locked

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at £16.99/month. Cancel anytime

Authors (2)

Gulati

Shekhar Gulati is a developer and OpenShift evangelist working with Red Hat. He has been evangelizing about OpenShift for the last 2 years. He regularly speaks at various conferences and user groups around the world to spread the goodness of OpenShift. He regularly blogs on the OpenShift official blog and has written more than 50 blogs on OpenShift. Shekhar has also written many technical articles for IBM developerWorks, Developer.com, and Javalobby.

See other products by Gulati

Kumar

Ashish Kumar is a seasoned data science professional, a publisher author and a thought leader in the field of data science and machine learning. An IIT Madras graduate and a Young India Fellow, he has around 7 years of experience in implementing and deploying data science and machine learning solutions for challenging industry problems in both hands-on and leadership roles. Natural Language Procession, IoT Analytics, R Shiny product development, Ensemble ML methods etc. are his core areas of expertise. He is fluent in Python and R and teaches a popular ML course at Simplilearn. When not crunching data, Ashish sneaks off to the next hip beach around and enjoys the company of his Kindle. He also trains and mentors data science aspirants and fledgling start-ups.

See other products by Kumar