Search icon CANCEL
Arrow left icon
Explore Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Conferences
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
The Supervised Learning Workshop

You're reading from   The Supervised Learning Workshop Predict outcomes from data by building your own powerful predictive models with machine learning in Python

Arrow left icon
Product type Paperback
Published in Feb 2020
Publisher Packt
ISBN-13 9781800209046
Length 532 pages
Edition 2nd Edition
Languages
Tools
Arrow right icon
Authors (4):
Arrow left icon
Blaine Bateman Blaine Bateman
Author Profile Icon Blaine Bateman
Blaine Bateman
Ashish Ranjan Jha Ashish Ranjan Jha
Author Profile Icon Ashish Ranjan Jha
Ashish Ranjan Jha
Ishita Mathur Ishita Mathur
Author Profile Icon Ishita Mathur
Ishita Mathur
Benjamin Johnston Benjamin Johnston
Author Profile Icon Benjamin Johnston
Benjamin Johnston
Arrow right icon
View More author details
Toc

2. Exploratory Data Analysis and Visualization

Activity 2.01: Summary Statistics and Missing Values

The steps to complete this activity are as follows:

  1. Import the required libraries:
    import json
    import pandas as pd
    import numpy as np
    import missingno as msno
    from sklearn.impute import SimpleImputer
    import matplotlib.pyplot as plt
    import seaborn as sns
  2. Read the data. Use pandas' .read_csv method to read the CSV file into a pandas DataFrame:
    data = pd.read_csv('../Datasets/house_prices.csv')
  3. Use pandas' .info() and .describe() methods to view the summary statistics of the dataset:
    data.info()
    data.describe().T

    The output of info() will be as follows:

    Figure 2.50: The output of the info() method (abbreviated)

    The output of describe() will be as follows:

    Figure 2.51: The output of the describe() method (abbreviated)

  4. Find the total count and total percentage of missing values in each column of the DataFrame and display them for columns having at least...
lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at R$50/month. Cancel anytime