Improve DATAFLOW GEN2 around KIMBALL Patterns [1# SNAPSHOTS]

Improve DATAFLOW GEN2 around KIMBALL Patterns [1# SNAPSHOTS]

• Offer something similar on DBT cloud to deal with rows snapshots (PK , values , Start_date , End_date)

• Based a primary key and columns , we need to track changes from Source (security==> SQL instructions to occur ==> only if datetime a business column value on source is >= targeted row one)

• "BIG revolution" , here on power query as we are on UPSERT or MERGE + INSERT , according to UPDATE an END_DATE system column value on current rows

and create a new ROW based new values ... similar primary KEY (PK , values , Start_date system , End_date system )