0

My aim is to make changes to my Azure Databricks notebooks using an IDE rather than in Databricks. While at the same time implementing some sort of version control.

Reading the Databricks-Connect documentation this doesn't look like it supports this kind of functionality. Was wondering if anyone else has tried to do this and had any success?

Iqram Choudhury
  • 29
  • 4
  • what prevents you from writing the code in the IDE & upload to Databricks? – Alex Ott Jun 07 '21 at 18:25
  • @Alex Ott I work for a company who's final product is in Databricks. The team want to take advantage of better development in an IDE and push the changes they have made to the notebooks with proper version control. I was wondering if this was possible using Databricks-Connect, since it allows us to access DBUtils, will it also allow me to make changes to notebooks remotely? – Iqram Choudhury Jun 08 '21 at 09:09
  • No, Databricks Connect won't make changes in the notebooks - it's designed to develop the code that will be deployed as jobs, for example, or as libraries that are used by the notebooks. – Alex Ott Jun 08 '21 at 11:03
  • If you want to get version control for notebooks, use Databricks Repos. But this work will be done in the databricks UI – Alex Ott Jun 08 '21 at 11:04

0 Answers0