Load CSV with spaces in column headers into table
When trying to load a CSV file with column headers in the first row containing spaces in the lakehouse via "right click> load to Tables" the process fails with an error:
"Invalid column name(s) 'Item Type,Sales Channel,Order Priority,Order...
Passwordless / Tokenless S3 Shortcut through federated Identity
Synapse / Azure Data Factory / Fabric OneLake Shortcuts should have AWS S3 Source with AWS IAM Roles Anywhere to establish a password less connection for multi cloud customers.
Federated identity should work with AzureAD and AWS so that the users themself do not need to store passwords o...
Enable preview and loading for archive data like zip or tar CSV files
Currently it is not possible to load tar, zip or other archives of data in the Data Engineering UI itself.
This would mean we always need to extract the data and store it somewhere with a Spark Job or something similar before using the possibility to load it into tables.
It would b...
TSQL in Spark Notebooks
For Synapse there is a tutorial on how to connect to a dedicated SQL pool from Spark in a notebook.
Having this for Fabric would be awesome.
In best case even running tsql via a tsql notebook magic, and then assigning the result of that query to a spark temp table.
<...