Data transformations refer to the infinite list of changes made on the data to reach its desired format. A lot of transformations can be done through simple expressions in queries, but there are also many challenges that are more complicated than these simple expressions. In this section, we will learn how to read data fully or incrementally, how to deduplicate data, and how to do data quality checks.
The first kind of transformation is often to recognize which data was loaded previously, if any. In the first section of this topic, we will learn how to load data fully or incrementally.