Summary
In this chapter, we have discussed how we can apply Delta Engine features such as Z-Ordering, Data Skipping, and data caching, among others, to improve the layout structure of our data, leading to an overall improvement in query performance. We can leverage these tools to reorganize files into lesser, much more compact ones, in which data is distributed according to how frequently it is accessed. We can also create Bloom filters on data columns to improve the speed in which we run our queries.
In the next chapter, we will deepen our knowledge of how to ingest streams of data in our Delta tables.