In distributed computing, a task is split into multiple small chunks or sub-tasks; each individual task is executed in different nodes of the cluster in parallel. This pattern offers high scalability and high performance through parallel processing.
Splitter and Aggregator is a well known enterprise integration pattern (EIP) used to split a parent task into multiple child tasks, execute the child messages in parallel (possibly using message queues to distribute the sub-tasks), and then aggregate the results of each sub-task.
The Apache Ignite Compute Grid API is the gateway to distributed computing. In this section, we are going to cover the following compute grid topics:
- Distributed Closure
- Map Reduce and Fork-Join
- ExecutorService
- Job Scheduling