Search icon CANCEL
Subscription
0
Cart icon
Cart
Close icon
You have no products in your basket yet
Save more on your purchases!
Savings automatically calculated. No voucher code required
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Python Natural Language Processing

You're reading from  Python Natural Language Processing

Product type Book
Published in Jul 2017
Publisher Packt
ISBN-13 9781787121423
Pages 486 pages
Edition 1st Edition
Languages
Toc

Table of Contents (13) Chapters close

Preface 1. Introduction 2. Practical Understanding of a Corpus and Dataset 3. Understanding the Structure of a Sentences 4. Preprocessing 5. Feature Engineering and NLP Algorithms 6. Advanced Feature Engineering and NLP Algorithms 7. Rule-Based System for NLP 8. Machine Learning for NLP Problems 9. Deep Learning for NLU and NLG Problems 10. Advanced Tools 11. How to Improve Your NLP Skills 12. Installation Guide

Apache Hadoop as a storage framework

Apache Hadoop is one of the widely used frameworks. Hadoop allows the distributed processing of large datasets across clusters of commodity computers using a simple programming model. Hadoop uses the concept of MapReduce. MapReduce divides the input query into small parts and processes them in parallel to the data stored on the Hadoop distributed file system (HDFS).

Hadoop has the following features:

  • It is scalable
  • It is cost-effective
  • It provides a robust ecosystem
  • It provides faster data processing

Hadoop can be used as a storage framework for NLP applications. If you want to store large amounts of data, then you can use a multinode Hadoop cluster and store data on HDFS. So, many NLP applications use HDFS for their historical data. Hadoop sends a program to the data and the data processes it locally. These features give Hadoop good speed...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at €14.99/month. Cancel anytime}