Daniel Scott on 09 Jun 2024 15:57:56
Currently the lineage view does not link any artifacts that have a data destination.
For example, a dataflow Gen2 can write data to a Lakehouse, however, it is not shown in the lineage view, and therefore you cannot see the original data source nor ETL related to that Lakehouse. The same applies to any data preparation artifact including notebooks, pipelines etc.
I would like to see the complete end to end lineage in the workspace lineage view which would increase the visibility of the flow of artifacts and work.