Alex Gorbunov on 25 Sep 2023 03:36:26
Dataflows are supported by the Deployment pipelines, but there is no Git integration for dataflows.
With the introduction of Git integration of workspaces, it would be fantastic if Dataflows could be stored and traced and reviewed in Git same like it is possible now for datasets and reports.
Administrator on 14 Dec 2023 07:20:02
Our team is aware of the need and we do plan to support Dataflow Gen2 in the future with Git integration. We will keep you posted once timelines are available.
- Comments (14)
RE: Git integration for Dataflows
Why this is not worked on, it is going to be almost a year since it was acknowledged. This is so important in order to know what is changing and when. I don't know why it doesn't have more votes.
RE: Git integration for Dataflows
Can someone from the dev team please provide an update about this?
RE: Git integration for Dataflows
A major client is asking for this functionality, and will be a blocker for their adoption of Fabric. It seems odd that a key feature is being excluded from CI/CD to be honest. Should be an easy enough to allow the .json file to be incorporated into source control, surely?
RE: Git integration for Dataflows
Please prioritize git integration for dataflows! It's not even on the roadmap which is frankly demoralizing to dev teams.
RE: Git integration for Dataflows
Dataflow gen2 are very convenient and easy to use. However, since they are still not included with git integration I feel this represents a risk. Any timeline for this would be greatly appreciated!
RE: Git integration for Dataflows
The facts:We see best practices about using GIT in FabricWe see Dataflows Gen2 being promotedBut:Dataflows Gen2 are not supported in GIT !?!Please add support for Dataflow Gen2 in GIT 🙏
RE: Git integration for Dataflows
Any status update?
RE: Git integration for Dataflows
Definitely it's a great addition to have Git integration for dataflow. Data flow is going to be a greate ETL tool in Fabric and needs to manage the versions of the changes.
RE: Git integration for Dataflows
This is horrible .. also it should be possible to adjust the JSON file especially for migration purposes of other platforms like Synapse.Currently every single dataflow has to be set up manually and connected to a destination.You should be able to automate this process using the JSON code.
RE: Git integration for Dataflows
Any updates here? Is this going to take months or years?How can you guys make call this stuff "GA" without any sort of CI/CD or git integration? You guys need to eat your own dogfood. It is shameful that you build this platform for hosting software solutions, yet have no meaningful plan for supporting CI/CD or source control. In past decades, Microsoft used to build very high quality development tooling for data engineers. Now I just want to avoid anything from Microsoft, and seek open-source alternatives which are much more robust, have better tooling, and have better support.