TSQL in Spark Notebooks
For Synapse there is a tutorial on how to connect to a dedicated SQL pool from Spark in a notebook.
Having this for Fabric would be awesome.
In best case even running tsql via a tsql notebook magic, and then assigning the result of that query to a spark temp table.
<...Pipeline Triggers based on Events in S3, GCS and all other Shortcutable Storages
To build event-based data processing in a Multi Cloud scenario it would be awesome to have event-based pipeline triggers for all the storage options that can be connected via shortcuts.
ADLS support is already there, implementation of event triggers might be hard as it would require list...
Support HierarchyID as data type in SQL Warehouse
The hierachyID is a pretty useful datatype to store huge hierarchies very performant. It would be very nice if this is supported by the Warehouse
https://learn.microsoft.com/en-us/sql/t-sql/data-types/hierarchyid-data-type-method-reference
Data Pipeline connector should support Oracle Database with Windows Auth
While the Data Flow Gen 2 supports Oracle with Windows Auth, the Data Pipeline does not support this.
But it should.
Function to restore blob after unintended deletion from OneLake
Is your feature request related to a problem? Please describe:
When deleting a File in a Lakehouse Folder unintentionally it should be possible to restore it via a simple python command. The data should still be avalailable because OneLake works with softdelete for 7 days. (https://learn...
Temporary OneLake File and Folder access similar to SAS Tokens on ADLS
ADLS offers the possibility to share data for a limited amount of time.
By setting an expiry date for access, you can ensure that sensitive data is only available for a limited time, reducing the risk of unauthorized access.
Similar to SAS Tokens on ADLS, this feature would provid...
Identity Federation for S3 shortcuts for tokenless Authentication based on Workspace Identity
To work with S3 shortcuts without storing credentials somewhere in Fabric would be amazing and more secure.
That would be possible with Identity Federation for passwordless Authentication based on Workspace Identity.
AWS IAM allows to build this, there should be a good i...
Azure EventHub to Fabric Eventstream Connection should be authenticated via RBAC roles
Azure EventHub to Fabric Eventstream Connection should be authenticated via RBAC roles.
Currently it only supports Shared Access Key authentication which requires manual management of Keys.
It would be preferred to use Role Based Access Control. If it is possible to use ...
Get data from Apache Kafka topics via private networking
Current prerequisites limit to public Kafka instances which is not feasible for most enterprise customers.
When will this limitation be lifted so that it can be used in private network setups, for example via gateway?
https://learn.microsoft.com/en-gb/fabric/real-time-in...