Search code examples
sqloracle-databasedata-warehousesql-data-warehousestar-schema-datawarehouse

What is the diff between Full table vs Delta table vs Incremental in dwh oracle


I am trying to understand the concept Full Table vs Incremental Table vs Delta table and in principle in order to simplify (faster loading process) the daily ETL loads is it a good practice to use Incremental table

FULL TABLE

INCREMENTAL TABLE

DELTA TABLE

i have read some where

Using incremental loads to move data can shorten the run times of your ETL processes and reduce the risk when something goes wrong

can some one please help me understanding the concept ?


Solution

    • full, as its name says, loads everything, the whole source data file
    • incremental - or delta (those are synonyms, not two different types) - mean that you load only data which you haven't loaded yet. It usually means that time of the last loading has been recorded. The next loading session loads data created after the last successful loading timestamp

    As of

    • "shortening run times": obviously, if you don't have to load everything but just what's missing, it takes less time
    • "reducing the risk": you don't mess up with data already loaded, it stays in the database. If something goes wrong, it goes wrong with current loading session so you can discard changes you've made and start over