2. Python's Main Tools for Statistics

Activity 2.01: Analyzing the Communities and Crime Dataset

Solution:

1. Once the dataset has been downloaded, the libraries can be imported, and pandas can be used to read in the dataset in a new Jupyter notebook, as follows:

   import pandas as pd
   import numpy as np
   import matplotlib.pyplot as plt
   df = pd.read_csv('CommViolPredUnnormalizedData.txt')
   df.head()

   We are also printing out the first five rows of the dataset, which should be as follows:

   Figure 2.21: The first five rows of the dataset

2. To print out the column names, we can simply iterate through df.columns in a for loop, like so:

   for column in df.columns:
       print(column)

3. The total number of columns in the dataset can be computed using the len() function in Python:

   print(len(df.columns))

4. To replace the special character '?' with np.nan objects, we can use the replace() method:

   df = df.replace('?', np.nan)

5. To print out...