Packt+ | Advance your knowledge in tech

You're reading from Python Machine Learning, Second Edition Machine Learning and Deep Learning with Python, scikit-learn, and TensorFlow

Product type Paperback

Published in Sep 2017

Publisher Packt

ISBN-13 9781787125933

Length 622 pages

Edition 2nd Edition

Languages

Python

Tools

Scikit-learn

Concepts

Deep Learning

Authors (2):

Vahid Mirjalili

Sebastian Raschka

View More author details

Table of Contents (18) Chapters

Preface

1. Giving Computers the Ability to Learn from Data

2. Training Simple Machine Learning Algorithms for Classification FREE CHAPTER

3. A Tour of Machine Learning Classifiers Using scikit-learn

4. Building Good Training Sets – Data Preprocessing

5. Compressing Data via Dimensionality Reduction

6. Learning Best Practices for Model Evaluation and Hyperparameter Tuning

7. Combining Different Models for Ensemble Learning

8. Applying Machine Learning to Sentiment Analysis

9. Embedding a Machine Learning Model into a Web Application

10. Predicting Continuous Target Variables with Regression Analysis

11. Working with Unlabeled Data – Clustering Analysis

12. Implementing a Multilayer Artificial Neural Network from Scratch

13. Parallelizing Neural Network Training with TensorFlow

14. Going Deeper – The Mechanics of TensorFlow

15. Classifying Images with Deep Convolutional Neural Networks

16. Modeling Sequential Data Using Recurrent Neural Networks

Index

Looking at different performance evaluation metrics

In the previous sections and chapters, we evaluated our models using model accuracy, which is a useful metric with which to quantify the performance of a model in general. However, there are several other performance metrics that can be used to measure a model's relevance, such as precision, recall, and the F1-score.

Reading a confusion matrix

Before we get into the details of different scoring metrics, let's take a look at a confusion matrix, a matrix that lays out the performance of a learning algorithm. The confusion matrix is simply a square matrix that reports the counts of the True positive (TP), True negative (TN), False positive (FP), and False negative (FN) predictions of a classifier, as shown in the following figure:

Although these metrics can be easily computed manually by comparing the true and predicted class labels, scikit-learn provides a convenient confusion_matrix function that we can use, as follows: