Developing a Text Classifier

A text classifier is a machine learning model that is capable of labeling texts based on their content. For instance, a text classifier will help you understand whether a random text statement is sarcastic or not. Presently, text classifiers are gaining importance as manually classifying huge amounts of text data is impossible.

Feature Extraction

When dealing with text data, features denote its different attributes. Generally, they are numeric representations of the text. As discussed in Chapter 2- Extraction Methods from Unstructured text, TF-IDF representations of texts are one of the most popular ways of extracting features from them.

Feature Engineering

Feature engineering is the art of extracting new features from existing ones. Extracting novel features, which tend to capture variation in data better, requires sound domain expertise.

Removing Correlated Features

Regression models, including logistic regression, are unable to perform...