In the earlier chapters, we covered how Kafka works, what kind of different components Kafka has, and what some of the Kafka tools that we can utilize for some specific use cases are. In this chapter, our focus is on understanding the importance of Kafka in big data applications. Our intention is for you to understand how Kafka can be used in any big data use cases and what are different types of design aspects you should keep in mind while using Kafka in this manner.
Kafka is becoming the standard tool for messaging in big data applications. There are some specific reasons for it. One of the reasons for it is that we can not use databases as the one-stop destination for all. Earlier, due to lack of elegant storage systems, databases tend to be the only solution for any type of data store. If you use a database, over a period of time, the system...
