Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Python Data Analysis

You're reading from   Python Data Analysis Perform data collection, data processing, wrangling, visualization, and model building using Python

Arrow left icon
Product type Paperback
Published in Feb 2021
Publisher Packt
ISBN-13 9781789955248
Length 478 pages
Edition 3rd Edition
Languages
Arrow right icon
Authors (2):
Arrow left icon
Ivan Idris Ivan Idris
Author Profile Icon Ivan Idris
Ivan Idris
Avinash Navlani Avinash Navlani
Author Profile Icon Avinash Navlani
Avinash Navlani
Arrow right icon
View More author details
Toc

Table of Contents (20) Chapters Close

Preface 1. Section 1: Foundation for Data Analysis
2. Getting Started with Python Libraries FREE CHAPTER 3. NumPy and pandas 4. Statistics 5. Linear Algebra 6. Section 2: Exploratory Data Analysis and Data Cleaning
7. Data Visualization 8. Retrieving, Processing, and Storing Data 9. Cleaning Messy Data 10. Signal Processing and Time Series 11. Section 3: Deep Dive into Machine Learning
12. Supervised Learning - Regression Analysis 13. Supervised Learning - Classification Techniques 14. Unsupervised Learning - PCA and Clustering 15. Section 4: NLP, Image Analytics, and Parallel Computing
16. Analyzing Textual Data 17. Analyzing Image Data 18. Parallel Computing Using Dask 19. Other Books You May Enjoy

Preprocessing data at scale

Dask preprocessing offers scikit-learn functionalities such as scalers, encoders, and train/test splits. These preprocessing functionalities work well with Dask DataFrames and Arrays since they can fit and transform data in parallel. In this section, we will discuss feature scaling and feature encoding.

Feature scaling in Dask

As we discussed in Chapter 7, Cleaning Messy Data, feature scaling, also known as feature normalization, is used to scale the features at the same level. It can handle issues regarding different column ranges and units. Dask also offers scaling methods that have parallel execution capacity. It uses most of the methods that scikit-learn offers:

Scaler Description
MinMaxScaler Transforms features by scaling each feature to a given range
RobustScaler Scales features using statistics that are robust to outliers
StandardScaler Standardizes features by removing the mean and scaling them to unit variance

Let's scale the last_evaluation...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $19.99/month. Cancel anytime