Building blocks of a cloud data warehouse
Fundamentally, cloud data warehouses consist of hardware managed by the cloud provider, operating on proprietary software, and connected to the internet over a network with many complex parts hidden away for the querying analyst. We will not discuss all this in depth. Instead, we will delve into the primary abstractions that are important to understand for a user.
Compute
Compute is the term that’s used for the processing power required to perform calculations, handle data operations, and execute queries in a computing environment, such as a CDWH. This involves using central processing units (CPUs), memory, and other computational resources to manage and analyze data efficiently. Some of the key improvements that CDWHs offer in terms of computing are as follows:
- MPP: For CDWHs, a huge improvement in computing came through the adoption of distributed computing and, in particular, leveraging MPP. This involves connecting...