Skip to main content

    Data Factory

    Merged

    Improve DATAFLOW GEN2 around KIMBALL Patterns [2# INCREMENTAL INGESTION S]

    Vote (1) Share
    Bamakus Montreuil's profile image

    Bamakus Montreuil on 18 Apr 2024 11:24:20

    Improve DATAFLOW GEN2 around KIMBALL Patterns [2# INCREMENTAL INGESTION S]



    • Offer something similar on DBT cloud to deal with INCREMENTAL APPEND <== Natively , not a workaround similar things we can see on the WEB


    • Automatic DFGEN2 process could be based ==> find / declare a "business" datetime column as criteria (WHERE ROW source datetime >= MAX target datetime all target )


    • Authorize to disable incremental APPEND option to perform a FULL for historical recovery










    Merged with Enable a way to set incremental refresh in Dataflows