Michael Del-Papa on 22 Aug 2024 14:12:08
For Copy Activities, the Source Connection cannot be set to the output of an activity i.e. @activity('MyActivity').output. Therefore, the very simple operation of saving the output of an activity as a JSON file in a Lakehouse requires invoking complex Notebooks in the pipeline. Furthermore, Dataflow Gen2 objects cannot read the output of an activity either. Therefore, integrating Dataflow Gen2 objects into a pipeline is essentially broken.