Skip to main content

Data Factory

Needs Votes

Reference .SQL file in Pipeline (w/ Git Integration)

Vote (1) Share
David Wagstaff's profile image

David Wagstaff on 02 May 2024 19:37:32

Create the ability to reference a .SQL file within Fabric Pipeline. In the Copy Data wizard, a button should be added when configuring the connection to the data source. If "Query" is selected, then there should be a button appear next to "Preview Data" that allows the user to open the file explorer and search for a .SQL which will then be imported into the copy data activity. A much more powerful feature would be to not import the .SQL file contents but allow Pipeline to reference the .SQL file directly from a remote repository like Git. This will allow developers to version control their queries used in the Copy Data activity outside of the Pipeline. An additional helpful feature would be integration with a remote repository to allow a series of .SQL files to be referenced which would create a metadata driven pipeline via custom sql scripting.