You're reading from In-Memory Analytics with Apache Arrow Perform fast and efficient data analytics on both flat and hierarchical structured data

Product type Paperback

Published in Jun 2022

Publisher Packt

ISBN-13 9781801071031

Length 392 pages

Edition 1st Edition

Languages

Tools

Apache arrow

Concepts

Big Data

Author (1):

Matthew Topol

View More author details

Table of Contents (16) Chapters

Preface

1. Section 1: Overview of What Arrow Is, its Capabilities, Benefits, and Goals

2. Chapter 1: Getting Started with Apache Arrow FREE CHAPTER

3. Chapter 2: Working with Key Arrow Specifications

4. Chapter 3: Data Science with Apache Arrow

5. Section 2: Interoperability with Arrow: pandas, Parquet, Flight, and Datasets

6. Chapter 4: Format and Memory Handling

7. Chapter 5: Crossing the Language Barrier with the Arrow C Data API

8. Chapter 6: Leveraging the Arrow Compute APIs

9. Chapter 7: Using the Arrow Datasets API

10. Chapter 8: Exploring Apache Arrow Flight RPC

11. Section 3: Real-World Examples, Use Cases, and Future Development

12. Chapter 9: Powered by Apache Arrow

13. Chapter 10: How to Leave Your Mark on Arrow

14. Chapter 11: Future Development and Plans

15. Other Books You May Enjoy

Summary

It doesn't matter what the shape or form of your data is, if you're going to be doing any sort of processing or manipulation of the data, then it pays to see whether Arrow can enhance your workflows. In this chapter, we've seen relational databases, analytical engines, and visualization libraries all powered by Apache Arrow. In each case, Arrow was being leveraged for a smaller memory footprint and generally better resource utilization than what had previously been done.

Every industry has a need for processing large amounts of data extremely quickly, from brand new scientific research to manufacturing metrics. If you are doing work with data processing, you can probably leverage Arrow somewhere in your pipeline. If you don't believe me, have a gander at the projects listed on the official Apache Arrow website as powered by Arrow: https://arrow.apache.org/powered_by/. You'll find every project mentioned in this chapter on that list, along with many...