Skip to main content
Microsoft Idea

Synapse

Planned

REST API and python SDK for Spark jobs

Vote (7) Share
Matthias Wong's profile image

Matthias Wong on 05 Jun 2023 06:22:12

The management of Spark jobs is done via the GUI Create an Apache Spark job definition - Microsoft Fabric | Microsoft Learn


This is fine for ad-hoc development, but not suitable for serious operationalising/automation of Spark pipelines. Please support a REST API and/or python SDK for developers to create/execute/monitor Spark jobs programmatically

Administrator on 29 Aug 2023 23:28:15

RestAPI and SDK support for Spark Job is planned and we already activtly working on this feature..