Nathan Marz coined the term Lambda Architecture (LA) to describe a generic pattern for data processing that is scalable and fault-tolerant. He gathered this expertise working extensively with big-data-related technologies at BackType and Twitter. The pattern is conceptualized to handle/process a huge amount of data by using two of its important components, namely batch and speed layer. Nathan generalized his findings and experience in the form of this pattern, which should cater to some of the important architecture principles, such as these:
- Linear scalable: It should scale out and not up and should cater to different kinds of use cases
- Fault-tolerant: Capable of a wide range of workloads, it should also shield the system from hardware and software failure and inherent human mistakes
- Backtype: Reads and updates
- Extensibility: Manageable, easy to extend, and easy to keep adding...
