You're reading from Data Engineering with Python Work with massive datasets to design data models and automate data pipelines using Python

Product type Paperback

Published in Oct 2020

Publisher Packt

ISBN-13 9781839214189

Length 356 pages

Edition 1st Edition

Languages

Python

Concepts

Data Analysis

Author (1):

Paul Crickard

Preface

1. Section 1: Building Data Pipelines – Extract Transform, and Load

2. Chapter 1: What is Data Engineering? FREE CHAPTER

3. Chapter 2: Building Our Data Engineering Infrastructure

4. Chapter 3: Reading and Writing Files

5. Chapter 4: Working with Databases

6. Chapter 5: Cleaning, Transforming, and Enriching Data

7. Chapter 6: Building a 311 Data Pipeline

8. Section 2:Deploying Data Pipelines in Production

9. Chapter 7: Features of a Production Pipeline

10. Chapter 8: Version Control with the NiFi Registry

11. Chapter 9: Monitoring Data Pipelines

12. Chapter 10: Deploying Data Pipelines

13. Chapter 11: Building a Production Data Pipeline

14. Section 3:Beyond Batch – Building Real-Time Data Pipelines

15. Chapter 12: Building a Kafka Cluster

16. Chapter 13: Streaming Data with Apache Kafka

17. Chapter 14: Data Processing with Apache Spark

18. Chapter 15: Real-Time Edge Data with MiNiFi, Kafka, and Spark

19. Other Books You May Enjoy

Appendix

Other Books You May Enjoy

If you enjoyed this book, you may be interested in these other books by Packt:

Practical Data Analysis Using Jupyter Notebook

Mark Wintjen

ISBN: 978-1-83882-603-1

Understand the importance of data literacy and how to communicate effectively using data
Find out how to use Python packages such as NumPy, pandas, Matplotlib, and the Natural Language Toolkit (NLTK) for data analysis
Wrangle data and create DataFrames using pandas
Produce charts and data visualizations using time-series datasets
Discover relationships and how to join data together using SQL
Use NLP techniques to work with unstructured data to create sentiment analysis models
Discover patterns in real-world datasets that provide accurate insights

The Data Analysis Workshop

Gururajan Govindan, Shubhangi Hora, Konstantin Palagachev

ISBN: 978-1-83921-138-6