Search icon CANCEL
Subscription
0
Cart icon
Your Cart (0 item)
Close icon
You have no products in your basket yet
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Apache Spark 3 for Data Engineering and Analytics with Python
Apache Spark 3 for Data Engineering and Analytics with Python

Apache Spark 3 for Data Engineering and Analytics with Python: Learn how to use Python and PySpark 3.0.1 for Data Engineering/Analytics (Databricks) - Beginner to Ninja

Arrow left icon
Profile Icon David Mngadi
Arrow right icon
$54.99
Full star icon Full star icon Full star icon Full star icon Full star icon 5 (2 Ratings)
Video Aug 2021 8hrs 30mins 1st Edition
Video
$54.99
Subscription
Free Trial
Renews at $19.99p/m
Arrow left icon
Profile Icon David Mngadi
Arrow right icon
$54.99
Full star icon Full star icon Full star icon Full star icon Full star icon 5 (2 Ratings)
Video Aug 2021 8hrs 30mins 1st Edition
Video
$54.99
Subscription
Free Trial
Renews at $19.99p/m
Video
$54.99
Subscription
Free Trial
Renews at $19.99p/m

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Billing Address

Key benefits

  • Apply PySpark and SQL concepts to analyze data
  • Understand the Databricks interface and use Spark on Databricks
  • Learn Spark transformations and actions using the RDD (Resilient Distributed Datasets) API

Description

Apache Spark 3 is an open-source distributed engine for querying and processing data. This course will provide you with a detailed understanding of PySpark and its stack. This course is carefully developed and designed to guide you through the process of data analytics using Python Spark. The author uses an interactive approach in explaining keys concepts of PySpark such as the Spark architecture, Spark execution, transformations and actions using the structured API, and much more. You will be able to leverage the power of Python, Java, and SQL and put it to use in the Spark ecosystem. You will start by getting a firm understanding of the Apache Spark architecture and how to set up a Python environment for Spark. Followed by the techniques for collecting, cleaning, and visualizing data by creating dashboards in Databricks. You will learn how to use SQL to interact with DataFrames. The author provides an in-depth review of RDDs and contrasts them with DataFrames. There are multiple problem challenges provided at intervals in the course so that you get a firm grasp of the concepts taught in the course. The code bundle for this course is available here: https://github.com/PacktPublishing/Apache-Spark-3-for-Data-Engineering-and-Analytics-with-Python-

Who is this book for?

This course is designed for Python developers who wish to learn how to use the language for data engineering and analytics with PySpark. Any aspiring data engineering and analytics professionals. Data scientists/analysts who wish to learn an analytical processing strategy that can be deployed over a big data cluster. Data managers who want to gain a deeper understanding of managing data over a cluster.

What you will learn

  • Learn Spark architecture, transformations, and actions using the structured API
  • Learn to set up your own local PySpark environment
  • Learn to interpret DAG (Directed Acyclic Graph) for Spark execution
  • Learn to interpret the Spark web UI
  • Learn the RDD (Resilient Distributed Datasets) API
  • Learn to visualize (graphs and dashboards) data on Databricks

Product Details

Country selected
Publication date, Length, Edition, Language, ISBN-13
Publication date : Aug 30, 2021
Length: 8hrs 30mins
Edition : 1st
Language : English
ISBN-13 : 9781803244303
Vendor :
Apache
Category :
Languages :
Concepts :

What do you get with a video?

Product feature icon Download this video in MP4 format
Product feature icon Access this title in our online reader with advanced features
Product feature icon DRM FREE - Read whenever, wherever and however you want
OR
Modal Close icon
Payment Processing...
tick Completed

Billing Address

Product Details

Publication date : Aug 30, 2021
Length: 8hrs 30mins
Edition : 1st
Language : English
ISBN-13 : 9781803244303
Vendor :
Apache
Category :
Languages :
Concepts :

Packt Subscriptions

See our plans and pricing
Modal Close icon
$19.99 billed monthly
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Simple pricing, no contract
$199.99 billed annually
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just $5 each
Feature tick icon Exclusive print discounts
$279.99 billed in 18 months
Feature tick icon Unlimited access to Packt's library of 7,000+ practical books and videos
Feature tick icon Constantly refreshed with 50+ new titles a month
Feature tick icon Exclusive Early access to books as they're written
Feature tick icon Solve problems while you work with advanced search and reference features
Feature tick icon Offline reading on the mobile app
Feature tick icon Choose a DRM-free eBook or Video every month to keep
Feature tick icon PLUS own as many other DRM-free eBooks or Videos as you like for just $5 each
Feature tick icon Exclusive print discounts

Frequently bought together


Stars icon
Total $110.95 $134.97 $24.02 saved
Apache Spark 3 for Data Engineering and Analytics with Python
$54.99
Essential PySpark for Scalable Data Analytics
$48.99
Data Engineering with Apache Spark, Delta Lake, and Lakehouse
$48.99
Total $110.95$134.97 $24.02 saved Stars icon

Table of Contents

5 Chapters
Introduction to Spark and Installation Chevron down icon Chevron up icon
Spark Execution Concepts Chevron down icon Chevron up icon
RDD Crash Course Chevron down icon Chevron up icon
Structured API - Spark DataFrame Chevron down icon Chevron up icon
Introduction to Spark SQL and Databricks Chevron down icon Chevron up icon

Customer reviews

Rating distribution
Full star icon Full star icon Full star icon Full star icon Full star icon 5
(2 Ratings)
5 star 100%
4 star 0%
3 star 0%
2 star 0%
1 star 0%
Ayo Apr 07, 2024
Full star icon Full star icon Full star icon Full star icon Full star icon 5
Just brilliant... clear delivery and well laid out curriculum.
Subscriber review Packt
Justin Nov 15, 2023
Full star icon Full star icon Full star icon Full star icon Full star icon 5
This is a great course, very clear with simple examples to follow. I love your voice, and the way you greet us with "Hello good people and welcome back". So soothing.
Subscriber review Packt
Get free access to Packt library with over 7500+ books and video courses for 7 days!
Start Free Trial

FAQs

How can I download a video package for offline viewing? Chevron down icon Chevron up icon
  1. Login to your account at Packtpub.com.
  2. Click on "My Account" and then click on the "My Videos" tab to access your videos.
  3. Click on the "Download Now" link to start your video download.
How can I extract my video file? Chevron down icon Chevron up icon

All modern operating systems ship with ZIP file extraction built in. If you'd prefer to use a dedicated compression application, we've tested WinRAR / 7-Zip for Windows, Zipeg / iZip / UnRarX for Mac and 7-Zip / PeaZip for Linux. These applications support all extension files.

How can I get help and support around my video package? Chevron down icon Chevron up icon

If your video course doesn't give you what you were expecting, either because of functionality problems or because the content isn't up to scratch, please mail customercare@packt.com with details of the problem. In addition, so that we can best provide the support you need, please include the following information for our support team.

  1. Video
  2. Format watched (HTML, MP4, streaming)
  3. Chapter or section that issue relates to (if relevant)
  4. System being played on
  5. Browser used (if relevant)
  6. Details of support
Why can’t I download my video package? Chevron down icon Chevron up icon

In the even that you are having issues downloading your video package then please follow these instructions:

  1. Disable all your browser plugins and extensions: Some security and download manager extensions can cause issues during the download.
  2. Download the video course using a different browser: We've tested downloads operate correctly in current versions of Chrome, Firefox, Internet Explorer, and Safari.