Stack Overflow
Stack Overflow

Questions tagged [databricks-repos]

For questions around Databricks Repos for Git integration.

This tag is for questions around Databricks Repos - development best practices, code organization, integration with CI/CD, deployment, etc.

58 questions
0
votes
0 answers

"databricks repos update" returns "try logging out of ADD and logging back in"

I am using the new Databricks cli (v0.203.2) With a Databricks PAT, and the workspace URL, I can successfully run commands like: databricks repos list and I see a list of repos However, when I run: databricks repos update, the following is…
Oliver Angelil
  • 1,099
  • 15
  • 31
0
votes
0 answers

How to make CI-CD with Azure Databricks and Azure DevOps to update repos

I'm struggling with CI-CD on Azure DevOps, we had a workflow in which we were able to use Databricks CLI command "databricks repos update" to update our repo in Databricks workspace, but we were using a user personal access token for that, now we…
jvb
  • 1
  • 1
0
votes
1 answer

Databricks Api: set Permissions for all Repos

The databricks docu allows to set permissions for specific repos such as: PATCH /api/2.0/permissions/repos/{RepoID} I would now set the permissions for all Repos. How can I do that? Simply removing the repoID leads to an error, in the UI it is…
user3579222
  • 1,103
  • 11
  • 28
0
votes
1 answer

Repo Icon Color-Coding in Databricks: what is the difference between a black and a white folder icon

In Databricks I have Repos with black and white icons. What does that mean?
user3579222
  • 1,103
  • 11
  • 28
0
votes
1 answer

Unable to run secondary notebook from Azure DevOps repo in Databricks due to 'file not found' error

I have my Azure DevOps repo cloned into Databricks. I'm trying to run the %run on a secondary notebook in the repo. When I attempt to execute the %run command on the secondary notebook, I consistently receive a file not found error. I'm working on…
Fred
  • 1
  • 1
0
votes
0 answers

How to unit-tests Databricks Notebook on Azure Devops Pull request

Currently, we are using Databricks Repo on Databricks with Azure Devops as .git. Azure Devops is configure to deploy new update on each branch [dev,main,release] using databricks repos update --path /Repos/dev/my_repo --branch dev databricks repos…
Gohmz
  • 1,256
  • 16
  • 31
0
votes
0 answers

Open Jupyter notebook on Databricks after cloning repo

As described in the title: I cloned a repo on Databricks and now I need to open and run a Jupyter notebook. How can I do that? If I open the file, I see it as a text file (see below).
albus_c
  • 6,292
  • 14
  • 36
  • 77
0
votes
1 answer

Folder Structure for CI/CD conform Databricks Repo

Are there any best-practices how to organize your project folders so that the CI/CD pipline remains simple? Here, the following structure is used, which seems to be quite complex: project │ README.md │ azure-pipelines.yml │ config.json │ …
user3579222
  • 1,103
  • 11
  • 28
0
votes
0 answers

Git DevOps integration with Databricks Repos - random outstanding changes on master immediately after repo clone

Sometimes there are some random outstanding changes on master branch, immediately after cloning git DevOps repository to Azure Databricks resource. It seems like these changes have to be in white spaces because in chnages log I can see that the…
Kamil Kacperski
  • 93
  • 1
  • 4
0
votes
1 answer

How do I copy a file from DBFS to REPOS on Databricks?

I'm currently working on moving a python .whl file that I have generated in dbfs to my repo located in /Workspace/Repos/My_Repo/My_DBFS_File, to commit the file to Azure DevOps. As Databricks Repos is a Read Only location it does not permit me to…
The Singularity
  • 2,428
  • 3
  • 19
  • 48
0
votes
1 answer

Update Databricks workspace notebook after pull request in GIT

I have GIT integrated in Azure Databricks and want to be able to have an updated notebook in my workspace every time I do a pull request into Dev for example, thereby having any update in GIT also appear in my workspace notebook. I believe there's a…
Rchee
  • 71
  • 1
  • 10
0
votes
0 answers

cURL request not working in GitHub actions, works locally

I’m attempting to make a cURL patch request via a GitHub action that executes when I make a push. The cURL call works perfectly when I execute it in Windows shell, but does nothing when I include it in a yaml file in my workflow. To be more…
Nick_89
  • 117
  • 2
  • 11
0
votes
2 answers

How do i automate Databricks notebook from Azure Devops

I am having all my codes in Azure Databricks notebook. I want to automate execution of my notebook using azure devops. I have linked my Databricks Repos with Azure Repos. Created a build pipeline to create artifact of my code. In release pipeline. I…
venkat
  • 111
  • 1
  • 1
  • 11
1 2 3
4