Data Factory
PlannedSupport UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Alexis Molteni on 14 Jul 2023 16:06:37
be able to do incremental loading from a pipeline.
Administrator on 19 Jul 2023 02:22:52
Upsert to Lakehouse Tables via Pipeline copy activity is in roadmap.
- Comments (9)
- Merged Idea (1)
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Is there any update on when this feature will be available?
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Even though Administrator comment says it is included on roadmap, I can't see it as of 22/Feb/2024
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
My current implementation involves obtaining data from multiple APIs simultaneously every day. I want to implement a process that does not rewrite or overwrite new data but appends it, taking into consideration the possibility of duplicates in consecutive API calls.
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
I would really appreciate having this Upsert feature in Fabric Pipelines as it is in Azure Data Factory. thanks.
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Really interested in having the option to Upsert or Insert, Update & Delete using copyData activity!
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Hey,Pipeline upsert is available, just hidden; a Microsoft Rep will be able to get it running for you - although it has been buggy,It would be powerful to have this for Dataflows as well as Pipelines.
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Please prioritize this feature to support UPSERT
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Yes would be great to see a smooth upsert feature in fabric
RE: Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
Customers want to update records from Dataflows and not just append or replace. Just yesterday Sunrise Living was having challenges with UPSERT's in Synapse. Thank you.