In this section, we will take you through big data design patterns, based on the following big data architectural patterns, and give a brief overview of the big data architectural patterns.
Big data architecture patterns
MapReduce pattern
MapReduce is a software framework implementation that processes and generates big datasets by applying parallel and distributed algorithms on a cluster infrastructure.
The primary methods of MapReduce are as follows:
- Map: Responsible for filtering and sorting
- Reduce: Responsible for operations (for example, counting the number of records)