Processing across partitions
Before we look at how to process data across partitions, first, let's understand partitions.
What are partitions?
Event Hubs can distribute incoming events into multiple streams so that they can be accessed, in parallel, by the consumers. These parallel streams are called partitions. Each partition stores the actual event data and metadata of the event such as its offset in the partition, its server-side timestamp when the event was accepted, its number in the stream sequence, and more. Partitioning helps in scaling real-time processing, as it increases the parallelism by providing multiple input streams for downstream processing engines. Additionally, it improves availability by redirecting the events to other healthy partitions if some of the partitions fail.
You can learn more about Event Hubs partitions at https://docs.microsoft.com/en-in/azure/event-hubs/event-hubs-scalability.
Now, let's look at how to send data across partitions...