Data processing

Data processing is a next step after the ingestion stage is successful. Each ingestion type we discussed previously has an equivalent data processing type. When we refer to data processing here, we generally talk about distributed data processing and there are a lot of scenarios that must be taken into consideration during the processing of data. It is also important to understand that a distributed system is designed to reduce the data processing time and we must take all the best practices into consideration before we start implementing a data processing application. In this section, we will walk you through each of the data processing types and some of the best practices that need to be taken into consideration.

Batch processing

...