Skip to main content

Data Factory

Planned

Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Vote (262) Share
Miguel Escobar's profile image

Miguel Escobar on 01 Jun 2023 17:44:52

Enable to modify the mashup document of a Dataflow Gen2 by passing a variable from a pipeline before an execution of the Dataflow

Administrator on 22 Aug 2024 17:14:52

This is currently in planning. Be sure to check out the release plan for timelines around this feature once they become available:

What's new and planned for Data Factory in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

Comments (28)
Miguel Escobar's profile image Profile Picture

Scott Lu on 12 May 2024 11:40:36

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Really need this, we stuck on this and have to delay our Fabric ETL implementation until this new functionality is available.

Miguel Escobar's profile image Profile Picture

Nikhil Patil on 10 May 2024 10:34:07

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

This is such a basic functionality that should have been available on day 1 !

Miguel Escobar's profile image Profile Picture

Soumen Das on 06 May 2024 09:34:45

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Must need this feature as early as possible as without this we can not proceed with any implementation at project level, which demands dynamic parameterization of data flow gen2.

Miguel Escobar's profile image Profile Picture

Ramesh Paskarathas on 19 Apr 2024 00:58:15

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Would really need this to streamline ingestion patterns.

Miguel Escobar's profile image Profile Picture

Vijaya Kabali on 04 Apr 2024 19:54:54

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Must have! Please let us know what is the efficient workaround till this is made available.

Miguel Escobar's profile image Profile Picture

Gabriel Almeida on 21 Mar 2024 15:42:16

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Passing variables from the Data Factory pipeline to DataFlowGen2 parameters would help in testing situations or changing data sources.Since current data flows are not supported by deployment pipelines.Many customers present this scenario, and have already asked me to recommend this improvement.

Miguel Escobar's profile image Profile Picture

Aslak Jonhaugen on 19 Mar 2024 18:27:58

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Must Have!

Miguel Escobar's profile image Profile Picture

Jeremy Young on 05 Mar 2024 19:33:29

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

I don't see it mentioned, but getting the parameter into the dataflow is not much use unless you can use it in a data source. Some will want it for working through a list of files. Others will want to inject it into a sql query (whether Direct Query or Import). I'd like both, please. Thx

Miguel Escobar's profile image Profile Picture

Chenghan Wang on 28 Dec 2023 04:14:03

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

Need this very much!!!!!

Miguel Escobar's profile image Profile Picture

Richard Rann on 09 Dec 2023 12:30:02

RE: Enable to pass variables from pipelines as parameters into a Dataflow Gen2

I would think this is a basic function. How can you not pass parameters into a Gen2 Dataflow, ie to dynamically build the SQL?I'd expect this in January