Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Databricks Certified Associate Developer for Apache Spark Using Python

You're reading from   Databricks Certified Associate Developer for Apache Spark Using Python The ultimate guide to getting certified in Apache Spark using practical examples with Python

Arrow left icon
Product type Paperback
Published in Jun 2024
Publisher Packt
ISBN-13 9781804619780
Length 274 pages
Edition 1st Edition
Languages
Arrow right icon
Author (1):
Arrow left icon
Saba Shah Saba Shah
Author Profile Icon Saba Shah
Saba Shah
Arrow right icon
View More author details
Toc

Table of Contents (18) Chapters Close

Preface 1. Part 1: Exam Overview
2. Chapter 1: Overview of the Certification Guide and Exam FREE CHAPTER 3. Part 2: Introducing Spark
4. Chapter 2: Understanding Apache Spark and Its Applications 5. Chapter 3: Spark Architecture and Transformations 6. Part 3: Spark Operations
7. Chapter 4: Spark DataFrames and their Operations 8. Chapter 5: Advanced Operations and Optimizations in Spark 9. Chapter 6: SQL Queries in Spark 10. Part 4: Spark Applications
11. Chapter 7: Structured Streaming in Spark 12. Chapter 8: Machine Learning with Spark ML 13. Part 5: Mock Papers
14. Chapter 9: Mock Test 1
15. Chapter 10: Mock Test 2
16. Index 17. Other Books You May Enjoy

Index

As this ebook edition doesn't have fixed pagination, the page numbers below are hyperlinked for reference only, based on the printed edition of this book.

Symbols

.join() method

parameters 82

A

actions 43

operations 43

Adaptive Query Execution (AQE) 80, 100

benefits 100

cost-based optimization 101

key components 100

memory management and tuning 101

workflow 100

aggregation operations 126

combining 127, 128

aggregations 153

Apache Mesos 38

Apache Spark

Adaptive Query Execution (AQE) 100

architecture 33, 34

caching 112

Catalyst optimizer 98

coalescing 114

data-based optimizations 102

data shuffle, managing 106, 107

data skew, tackling 103, 105

data spills, managing 105

deployment modes 40, 41

execution flow 34, 35

features 20, 21

file problem, addressing 102

integration with 121

narrow transformations 110

optimizations 97, 98

partitioning 39, 40

...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at £16.99/month. Cancel anytime