Reading streaming data from Azure Event Hubs

In this recipe, you will learn how to connect an Azure Event Hubs streaming data source from Azure Databricks to process data in real time. You will set up the data process using Azure Event Hubs and read messages coming from the Event Hub using Azure Databricks. To access the streaming data, you will set up a streaming data producer application in Python to ingest vehicle information.

Getting ready

Before you start working on this recipe, please ensure you have gone through the following points:

• You can create an Event Hub namespace and an Event Hub within the namespace in accordance with the Microsoft documentation available at https://docs.microsoft.com/en-us/azure/event-hubs/event-hubs-create.
• You can use the Python script, Event_producer.py, which will push the data to Azure Event Hubs as a streaming data producer You can get the Python script from https://github.com/PacktPublishing/Azure-Databricks-Cookbook/blob...