on 16 May 2024 18:15:12
In notebook you can freeze a cell, in pipeline you can deactivate an activity. Similar feature would be a great addition in Dataflow Gen2. I understand that I can copypaste queries between dataflows, but it can be cumbersome and would clutter the workspace. Sometimes just deactivating one of the queries for the publishment would do the trick.
Administrator on 21 May 2024 19:29:56
Hi! Could you please share more information about what it would mean to deactivate a query? today you can simply disable staging and the effect would be to not load the query at all. It would only be processed if required in the event that its part of an output destination or a subsequent query that does have staging enabled
- Comments (1)
RE: Deactivating queries in Dataflow Gen2
Hi,Apologies for delay. You are right, deactivating staging inactivates the query (it is shown in italics and greyed out). That was useful! One thing I would consider here is that Staging in documentation is created to improve performance and manage large volumes of data. It is not explicitly stated anywhere that disabling Staging will stop the query from running.Additionally, it seems that I needed to enable Staging and later disable it to stop the query from running (?). Here I'm not sure since it was strictly trial and error, but it would be beneficial if it was somehow clearly explained.