Summary

In this chapter, we covered the various data types and data formats that are available. We also discussed the various popular data formats that are used in modern data engineering and the compression techniques that are compatible with each. Once we understood the data types and formats, we explored various data storage formats – file, block, and object storage – we can use to store the data. Then, we discussed various kinds of enterprise data repositories in detail – data lake, data warehouse, and data marts. Once we covered the basics of data, including the different types and their storage, we briefly discussed databases and their types. We discussed various examples of databases, the USP of each kind of database, and when a particular kind of database should be chosen over another. We explored possible use cases when a database should be used.

Finally, we briefly covered the basic design considerations that a data architect should keep in mind while...