Skip to main content

Core

New

Add option to add not default (multiple) lakehouses to notebooks e.g. using PySpark

Vote (2) Share
Rashid Abdel-Majid's profile image

Rashid Abdel-Majid on 26 Sep 2024 07:47:15

I need function to add multiple lakehouses in nootebook automatic/scripting


Problem: Then I use Deployment Pipeline, its take all lakehouses from Dev workspace, and I need to change every lakehouses manually every time. Multiple of my nootebook using 3 to 6 leakhous. and if i forgot to change them all, then i write produktion data to Dev or Test.


So i need function to change/add multiple lakehouses in notebook.


And I need function to check if Data Pipeline i schedule, run notebook (and all lakehouses in notebook) in same workspace, if not, then fail.