Support SELECT * EXCEPT(..) in Spark SQL -- Necessary Quality of Life Feature
Virtually all the key players in this space support this quality-of-life feature, including Databricks, Snowflake, BigQuery, DuckDB, and quite a few others.
The EXCEPT feature is a necessary feature to support any migration of existing SQL scripts. Significant re-architecture ...
Support QUALIFY in Spark SQL -- Necessary Quality of Life Feature
Virtually all the key players in this space support this quality-of-life feature, including Databricks, Snowflake, BigQuery, DuckDB, and quite a few others.
The QUALIFY feature is a necessary feature to support any migration of existing SQL scripts. Significant re-architectur...
Add Lakehouse Support for UDTFs (User-Defined Table Functions, aka TVFs or Table-Value Functions)
Being able to create a UDTF (user-defined table function), also known as a tabular UDF, table UDF, UDF table function, or a TVF (user-defined table-value function), are incredibly useful and very powerful, especially in combination with LATERAL invocations.
Ot...
Expose access to INFORMATION_SCHEMA within Lakehouse
In Databricks, as with most DBMS, one can query INFORMATION_SCHEMA.VIEWS or INFORMATION_SCHEMA.C...
Add Support for Recursive CTEs in Lakehouse, Data Warehouse
Recursive CTEs are incredibly useful for resolving queries against hierarchal data. This is why virtually all major database platforms support recursive CTEs!
There is a starter issue with Apache with some progress made on it, but it seems to be stuck. As a separate matter, ...