Summary

This concludes our section on Kafka consumers. This chapter addresses one of the key functionalities of Kafka message flows. The major focus was on understanding consumer internal working and how the number of consumers in the same group and number of topic partitions can be utilized to increase throughput and latency. We have also covered how to create consumers using consumer APIs and how to handle message offsets in case consumer fails.
We started with Kafka consumer APIs and also covered synchronous and asynchronous consumers and their advantages and disadvantages. We explained how to increase the throughput of a consumer application. We then went through the consumer rebalancer concept and when it gets triggered and how we can create our own rebalancer. We also focused on different consumer patterns that are used in different consumer applications. We focused on...