Ben Coleman on 28 Jul 2023 16:32:06
Often Data factory is managed with a SQL server to manage watermarks, queries, batch size configuration etc. to be used with dynamic content in order to increase reuse and repeatability. Currently there is no standard SQL server function or configuration management of Data factory within Fabric meaning customers would have to create the database in Azure limiting the 'one stop shop' and SaaS offering of Fabric.
Being able to create a simple light database within fabric that has standard SQL capabilities would be great. Integrating it more with DF would be even better as it would lower confusion of why a standard SQL server would be needed.
Current workaround is to use a SQL warehouse though functionality is limited.
Administrator
Interesting idea, thank you for submitting! Can you provide some additional details for this use case so we can consider these options? TY!
- Comments (1)
RE: Management of Fabric configuration
This is a great idea. Thank you for submitting it.When we develop metadata driven pipeline or reusable pipelines or dataflows, we need to store the metadata somewhere (ex: Azure SQL), if we have the ability to store this metadata with 100% t-sql support that helps a lot and we don't need to create Azure SQL service outside fabric.