Skip to main content

    Data Factory

    Completed

    Enable a way to set incremental refresh in Dataflows

    Vote (264) Share
    Miguel Escobar's profile image

    Miguel Escobar on 31 May 2023 20:13:25

    Enable an experience that allows the end-user to setup incremental refresh for Dataflows Gen2 in Data Factory for Microsoft Fabric

    Administrator on 30 Sep 2024 20:33:25

    Incremental refresh is now available for Dataflow Gen2. Learn more from the link below:

    Incremental refresh in Dataflow Gen2 - Microsoft Fabric | Microsoft Learn

    Comments (12)
    Miguel Escobar's profile image Profile Picture

    Jason Campbell on 14 Jul 2023 17:41:56

    RE: Enable a way to set incremental refresh in Dataflows

    Incremental refreshes are sorely needed when getting data from on-prem SQL servers. Not having this ability can be (is) a deal breaker.

    Miguel Escobar's profile image Profile Picture

    Edgar Walther on 31 May 2023 20:29:51

    RE: Enable a way to set incremental refresh in Dataflows

    Add a Table Action option for Incremental Load. Let the user identify the Primary Key column(s) from the source (or read meta data from source) Add some auditing columns (is current, is active, is deleted, load date, update date, current key)Add new rows, update existing rows, mark deleted rows.Or is some of this plumbing already taken care of by the delta tables?

    Merged Idea (1)