Search icon CANCEL
Subscription
0
Cart icon
Cart
Close icon
You have no products in your basket yet
Save more on your purchases!
Savings automatically calculated. No voucher code required
Arrow left icon
All Products
Best Sellers
New Releases
Books
Videos
Audiobooks
Learning Hub
Newsletters
Free Learning
Arrow right icon
Arrow up icon
GO TO TOP
Hands-On Artificial Intelligence for IoT - Second Edition

You're reading from  Hands-On Artificial Intelligence for IoT - Second Edition

Product type Book
Published in Jan 2019
Publisher Packt
ISBN-13 9781788836067
Pages 390 pages
Edition 2nd Edition
Languages
Author (1):
Amita Kapoor Amita Kapoor
Profile icon Amita Kapoor
Toc

Table of Contents (20) Chapters close

Title Page
Copyright and Credits
Dedication
About Packt
Contributors
Preface
1. Principles and Foundations of IoT and AI 2. Data Access and Distributed Processing for IoT 3. Machine Learning for IoT 4. Deep Learning for IoT 5. Genetic Algorithms for IoT 6. Reinforcement Learning for IoT 7. Generative Models for IoT 8. Distributed AI for IoT 9. Personal and Home IoT 10. AI for the Industrial IoT 11. AI for Smart Cities IoT 12. Combining It All Together 1. Other Books You May Enjoy Index

HDFS


HDFS is a popular storage and access method for storing and retrieving data files for IoT solutions. The HDFS format can hold large amounts of data in a reliable and scalable manner. Its design is based on the Google File System (https://ai.google/research/pubs/pub51). HDFS splits individual files into fixed-size blocks that are stored on machines across the cluster. To ensure reliability, it replicates the file blocks and distributes them across the cluster; by default, the replication factor is 3. HDFS has two main architecture components:

  • The first, NodeName, stores the metadata for the entire filesystem, such as filenames, their permissions, and the location of each block of each file. 
  • The second, DataNode (one or more), is where file blocks are stored. It performs Remote Procedure Calls (RPCs) using protobufs.

 

Note

RPC is a protocol that one program can use to request a service from a program located on another computer on a network without having to know the network's details. A...

lock icon The rest of the chapter is locked
Register for a free Packt account to unlock a world of extra content!
A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.
Unlock this book and the full library FREE for 7 days
Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of
Renews at $15.99/month. Cancel anytime