Skip to main content

Fabric platform

New

Have an on-demand (or serverless?) pricing model/option for Fabric capacities

Vote (5) Share
Rocket Porg's profile image

Rocket Porg on 23 Aug 2024 15:33:23

In the old Azure Synapse we had serverless SQL with an on-demand pricing model (i.e. pay per query). Similar to that when running a Spark notebook you pay for the cluster while it runs the job. Lastly, its the same for data factory pipeline runs, you only pay for each run. So when nothing is running you only pay for the data storage in the relevant data lakes connected to your Synapse workspace.


In my use case I've got a number of small jobs that either need to just run a notebook, a data factory pipeline. Then occasionally throughout the day users may run queries on the processed data. However, unlike Synapse, with Fabric I have to worry about having a 'capacity' and also pausing/resuming this capacity (and obviously I could setup a pause/resume process), but my dream payment model would be to have an option more like the pricing of Azure Synapse. So the scenario would be like:-


a) No capacity to worry about pausing/resuming

b) Only pay for data lake (OneLake in this case) storage when nothing is running (yes, I know OneLake storage pricing works like this already, I'm just listing my 'dream' scenario)

c) Pay per SQL query when users are running a query, or stored procs or data factory is hitting the 'Synapse Warehouse'

d) Pay per notebook run in the lakehouse


Plus probably similar options for other parts of Fabric like the realtime stuff etc... although personally I'm not using any of those at the moment for this project I'm on...


I think to achieve this you could just have choice to create an 'on-demand' capacity (or maybe a tick box to make a capacity on-demand or 'serverless'?) when you choose your capacity in Azure portal and hey presto, sorted! Please make my dreams come true ;-)