The technology matrix for Lambda Architecture
In this section, we will discuss various technology options available for developing the various layers of Lambda Architecture.
Lambda Architecture talks about four different layers, and each layer has its own function and purpose. Let's look at the variety of technologies available that can be leveraged for developing these layers of Lambda Architecture:
The data consumption layer is the first layer in the overall architecture. Going by the name, it seems to be the simplest layer, but, in reality, it needs to deal with a lot of complexities. Here are a few challenges that we need to keep in mind before developing or choosing any technology for the data consumption layer:
- Highly available: It should be highly available and it should be ensured that it works either in master, slave, or peer architecture. There should be no single point of failure that can stop the consumption of messages.
- Fault tolerant: It is extremely important that it is...
