Introduction

Classification models are a popular way to predict a defined categorical outcome. We use outputs from classification models all the time. Anytime we go to see a movie in a theatre, we are interested to know whether the film is considered correct? One of the most popular classification models in the data science community is a logistic regression. The logistic regression model produces a response that is activated by a sigmoid function. The sigmoid function uses the inputs from the model and produces an output that is between 0 and 1. That output is usually in a form of a probability score. Many deep learning models are also used for classification purposes. It is common to find logistic regression models performed in conjunction with deep learning models to help establish a baseline in which deep learning models are measured against. The sigmoid activation function is one of many activation functions that are also used in deep neural networks within deep learning to produce...