Skip to main content

Power BI

Needs Votes

Add Incremental Updates to Enterprise Gateway

Vote (49) Share
Fahd EL YOUBI's profile image

Fahd EL YOUBI on 03 Jun 2016 20:26:30

As a pro user,
I want the enterprise gateway to support increment updates
so that my yuge datasets be updated quickly and more efficiently.

Comments (1)
Fahd EL YOUBI's profile image Profile Picture

Fahd EL YOUBI on 05 Jul 2020 22:22:47

RE: Add Incremental Updates to Enterprise Gateway

This must be one of the biggest challenges in the big data realm. There are updates and inserts. While the former is a lot more challenging to achieve, the latter seems to be straightforward. What if, we can set up the type of refresh per table in a dataset?
To put this into a context, I have a table (Marketing_Email with Millions of records) that I know I perform an incremental ETL job using only insert, would it be great if I can tell the gateway, just refresh the Marketing_Email by inserting only using some kind of indicator (Key, Datetime, etc...)?
It would definitely save us hours worth refresh time.

Thanks