Understanding basic architecture patterns
In this section, we will examine the basic architecture pattern of the modern data warehouse (see the following diagram) and examine the components in a bit more detail:
Figure 2.1 – High-level modern data warehouse architecture
We'll now dive into the scalable components in the following section.
Examining the scalable storage component
This points to a storage component that must be able to store any amount of data in any format. We need to be able to create folder structures of the necessary depth. The component needs to offer high throughput when writing, as well as reading, data. Additionally, security is of high importance, and we need at least a Portable Operating System Interface (POSIX)-like interface with the option to configure access control that's both file- and folder-based. This means we must be able to control who can read, write, or execute content that is stored here.
As...
