NLP example overview

In this section, we will review the end-to-end machine learning workflow that will help us understand how to schedule it in Pachyderm.

To demonstrate this functionality, we will create an NLP pipeline that will perform various text optimizations against the The Legend of Sleepy Hollow short story book written by Washington Irving.

But first, let's review what NLP is and the typical stages that are involved in NLP.

Introduction to NLP

NLP is a machine learning technique that enables you to analyze natural text, namely speech or written text. This branch of artificial intelligence has existed for many years, but with the advancement of computer and internet technologies, it has found new implementations.

So, how can you use NLP in your business or academic research? There are many ways, but the most common ones include the following:

• Speech recognition: Technology that enables computers to understand human voice and speech.
• Chatbots...