Introducing Pub/Sub and employing Kafka with Python using the confluent-kafka library

Before we get into what the modern Pub/Sub model is, let’s go into a bit of detail about the technology that made this field possible: Apache Kafka, the third most famous Kafka after Franz and Kafka on the Shore. Originally designed for use in LinkedIn (a great website), it was made open source in early 2011. The concept behind it was pretty simple: there is a log of information and events that any number of systems can consume, and data can be published to the log for consumption by these systems. Sound simple enough? Well, it is now, but it took some thinking to come up with it. But this is the system that is responsible for most modern data infrastructure that we see today. Have you ever gotten a notification on your phone? It is because of this library. Have you ever made a contactless payment with your phone or credit card? Chances are, Kafka’s in there. Ever gotten a notification...