You're reading from Python for Geeks Build production-ready applications using advanced Python concepts and industry best practices

Product type Paperback

Published in Oct 2021

Publisher Packt

ISBN-13 9781801070119

Length 546 pages

Edition 1st Edition

Languages

Python

Tools

Django

Concepts

Programming Language

Author (1):

Muhammad Asif

View More author details

Table of Contents (20) Chapters

Preface

1. Section 1: Python, beyond the Basics

2. Chapter 1: Optimal Python Development Life Cycle FREE CHAPTER

3. Chapter 2: Using Modularization to Handle Complex Projects

4. Chapter 3: Advanced Object-Oriented Python Programming

5. Section 2: Advanced Programming Concepts

6. Chapter 4: Python Libraries for Advanced Programming

7. Chapter 5: Testing and Automation with Python

8. Chapter 6: Advanced Tips and Tricks in Python

9. Section 3: Scaling beyond a Single Thread

10. Chapter 7: Multiprocessing, Multithreading, and Asynchronous Programming

11. Chapter 8: Scaling out Python Using Clusters

12. Chapter 9: Python Programming for the Cloud

13. Section 4: Using Python for Web, Cloud, and Network Use Cases

14. Chapter 10: Using Python for Web Development and REST API

15. Chapter 11: Using Python for Microservices Development

16. Chapter 12: Building Serverless Functions using Python

17. Chapter 13: Python and Machine Learning

18. Chapter 14: Using Python for Network Automation

19. Other Books You May Enjoy

Case studies of using Apache Spark and PySpark

In previous sections, we covered the fundamental concepts and architecture of Apache Spark and PySpark. In this section, we will discuss two case studies for implementing two interesting and popular applications for Apache Spark.

Case study 1 – Pi (π) calculator on Apache Spark

We will calculate Pi (π) using the Apache Spark cluster that is running on our local machine. Pi is the area of a circle when its radius is 1. Before discussing the algorithm and the driver program for this application, it is important to introduce the Apache Spark setup used for this case study.

Setting up the Apache Spark cluster

In all previous code examples, we used PySpark locally installed on our machine without a cluster. For this case study, we will set up an Apache Spark cluster by using multiple virtual machines. There are many virtualization software tools available, such as VirtualBox, and any of these software tools will...