Incremental refresh
Incremental refresh was available only in Premium capacities. However, from February 2020 onward, it is also supported in the Professional licensing tier. Incremental refresh refers to incremental data loading, which has been around for a long time. Let's see what incremental refresh (or incremental data loading) is.
From a technical standpoint in data movement, there are always two options when we transfer data from location A
to location B
:
- Truncation and load: We transfer the data as a whole from location
A
to locationB
. If locationB
contains some data already, we truncate locationB
entirely and reload the entire data from locationA
toB
. - Incremental load: We transfer the data as a whole from location
A
to locationB
just once for the first time. The next time, we only load the data changes fromA
toB
. In this approach, we never truncateB
. Instead, we only transfer the data that exists inA
but not inB
.
When we refresh the data...