Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Apache Spark: Tips, Tricks, & Techniques
Apache Spark: Tips, Tricks, & Techniques

Apache Spark: Tips, Tricks, & Techniques: Discover Techniques to Test, Immune, and Parallelize Spark Jobs

Arrow left icon
Profile Icon Tomasz Lelek
Arrow right icon
€112.99
Video Nov 2018 2hrs 26mins 1st Edition
Video
€112.99
Subscription
Free Trial
Renews at €18.99p/m
Arrow left icon
Profile Icon Tomasz Lelek
Arrow right icon
€112.99
Video Nov 2018 2hrs 26mins 1st Edition
Video
€112.99
Subscription
Free Trial
Renews at €18.99p/m
Video
€112.99
Subscription
Free Trial
Renews at €18.99p/m

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Billing Address

Key benefits

  • • Speed up your Spark jobs by reducing shuffles
  • • Leverage the Key/Value API in your big data processing to make your jobs work faster with lower network traffic
  • • Test Spark jobs using the unit, integration, and end-to-end techniques to make your data pipeline robust and bullet proof

Description

Apache Spark has been around for quite some time, but do you really know how to get the most out of Spark? This course aims at giving you new possibilities; you will explore many aspects of Spark, some you may have never heard of and some you never knew existed. In this course you'll learn to implement some practical and proven techniques to improve particular aspects of programming and administration in Apache Spark. You will explore 7 sections that will address different aspects of Spark via 5 specific techniques with clear instructions on how to carry out different Apache Spark tasks with hands-on experience. The techniques are demonstrated using practical examples and best practices. By the end of this course, you will have learned some exciting tips, best practices, and techniques with Apache Spark. You will be able to perform tasks and get the best data out of your databases much faster and with ease. All the code and supporting files for this course are available on Github at https://github.com/PacktPublishing/Apache-Spark-Tips-Tricks-Techniques

Who is this book for?

This course is for Apache Spark developers who want to learn some useful, interesting ways to further improve their Apache Spark skills for processing and analyzing a large amount of data in a much faster, unique, and easy way.

What you will learn

  • • Compose Spark jobs from actions and transformations
  • • Create highly concurrent Spark programs by leveraging immutability
  • • Ways to avoid the most expensive operation in the Spark API—Shuffle
  • • How to save data for further processing by picking the proper data format saved by Spark
  • • Parallelize keyed data; learn of how to use Spark's Key/Value API
  • • Re-design your jobs to use reduceByKey instead of groupBy
  • • Create robust processing pipelines by testing Apache Spark jobs
  • • Solve repeated problems by leveraging the GraphX API

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Nov 30, 2018
Length: 2hrs 26mins
Edition : 1st
Language : English
ISBN-13 : 9781789801125
Vendor :
Apache
Category :
Languages :
Concepts :

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Billing Address

Product Details

Publication date : Nov 30, 2018
Length: 2hrs 26mins
Edition : 1st
Language : English
ISBN-13 : 9781789801125
Vendor :
Apache
Category :
Languages :
Concepts :

Packt Subscriptions

See our plans and pricing
Modal Close icon
€18.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
€189.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts
€264.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just €5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total 344.97
Data Stream Development with Apache Spark, Kafka, and Spring Boot
€118.99
Apache Spark: Tips, Tricks, & Techniques
€112.99
Troubleshooting Apache Spark
€112.99
Total 344.97 Stars icon

Table of Contents

7 Chapters
Transformations and Actions Chevron down icon Chevron up icon
Immutable Design Chevron down icon Chevron up icon
Avoid Shuffle and Reduce Operational Expenses Chevron down icon Chevron up icon
Saving Data in the Correct Format Chevron down icon Chevron up icon
Working with Spark Key/Value API Chevron down icon Chevron up icon
Testing Apache Spark Jobs Chevron down icon Chevron up icon
Leveraging Spark GraphX API Chevron down icon Chevron up icon
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

How can I download a video package for offline viewing? Chevron down icon Chevron up icon
  1. Login to your account at Packtpub.com.
  2. Click on "My Account" and then click on the "My Videos" tab to access your videos.
  3. Click on the "Download Now" link to start your video download.
How can I extract my video file? Chevron down icon Chevron up icon

All modern operating systems ship with ZIP file extraction built in. If you'd prefer to use a dedicated compression application, we've tested WinRAR / 7-Zip for Windows, Zipeg / iZip / UnRarX for Mac and 7-Zip / PeaZip for Linux. These applications support all extension files.

How can I get help and support around my video package? Chevron down icon Chevron up icon

If your video course doesn't give you what you were expecting, either because of functionality problems or because the content isn't up to scratch, please mail customercare@packt.com with details of the problem. In addition, so that we can best provide the support you need, please include the following information for our support team.

  1. Video
  2. Format watched (HTML, MP4, streaming)
  3. Chapter or section that issue relates to (if relevant)
  4. System being played on
  5. Browser used (if relevant)
  6. Details of support
Why can’t I download my video package? Chevron down icon Chevron up icon

In the even that you are having issues downloading your video package then please follow these instructions:

  1. Disable all your browser plugins and extensions: Some security and download manager extensions can cause issues during the download.
  2. Download the video course using a different browser: We've tested downloads operate correctly in current versions of Chrome, Firefox, Internet Explorer, and Safari.