Skip to main content

Fabric platform

New

Add option in Copy Data activity for schema evolution with Append when writing to Lakehouse tables

Vote (17) Share
Andy Cutler's profile image

Andy Cutler on 26 Oct 2023 14:39:49

At the moment, the only options in a Data Pipeline Copy Data task when writing to a Lakehouse table is Append or Overwrite. When selecting Append, it does not allow schema evolution. When set to Overwrite it does support schema evolution, but it overwrites all the data in the table.


I would like another option to allow schema evolution in append mode in the Copy Data activity, like this "Delta Lake schema evolution with mergeSchema set to true")



Comments (3)
Andy Cutler's profile image Profile Picture

August Asheim Birkeland on 19 Feb 2024 10:57:16

RE: Add option in Copy Data activity for schema evolution with Append when writing to Lakehouse tables

I agree! We would really benefit from this.

Andy Cutler's profile image Profile Picture

Trey U on 12 Dec 2023 16:24:40

RE: Add option in Copy Data activity for schema evolution with Append when writing to Lakehouse tables

A much needed feature!

Andy Cutler's profile image Profile Picture

George Kirkham on 26 Oct 2023 22:15:27

RE: Add option in Copy Data activity for schema evolution with Append when writing to Lakehouse tables

Having this flexibility would be really useful.