Stack Overflow
Stack Overflow

Questions tagged [databricks-cli]

67 questions
2
votes
1 answer

Execute git pull on databricks notebook using CLI and/or API

Using Databricks Repos, you can add a git repo to Databricks and execute git actions such as git pull. This is done by clicking on the branch name in the top left, and clicking the button saying "Pull". I would like to do this without clicking on…
Haterind
  • 1,095
  • 1
  • 8
  • 16
2
votes
1 answer

Using JAR files as Databricks Cluster library

I need to install a JAR file as a library while setting up a Databricks cluster as part of my Azure Release pipeline. As of now, I have completed the following - use an Azure CLI task to create the cluster definition use curl command to download…
Subhash Ghai
  • 75
  • 1
  • 8
2
votes
1 answer

databricks secret scope 'bad request'

getting a 'bad request' error after following the below process in command prompt, please correct me.. pip install databricks-cli databricks configure –-token Databricks Host (should begin with https://): Token:
user16628047
2
votes
1 answer

Databricks CLI Error databricks-connect' is not recognized

Databricks CLI worked a year and half ago, when I last worked with it. Since then I have mostly used API. Now, I wanted to use Databricks CLI again (on a new PC) and it does not work. "The term 'databricks-connect' is not recognized as the name of a…
Saugat Mukherjee
  • 778
  • 8
  • 32
2
votes
1 answer

databricks-cli: JSONDecodeError when running job in bash script

I am trying to run a Databricks job with notebook parameters within a bash script on a Linux server. I am following instructions from the docs and I have verified that the commands work in terminal. Here is my script: #!/bin/bash ### this commands…
Korean_Of_the_Mountain
  • 1,428
  • 3
  • 16
  • 40
2
votes
2 answers

Databricks CLI Not Installing on Ubuntu 18.04

I have successfully installed the databricks cli on Ubuntu 16.04 and Mac. When I am trying to install it on Ubuntu 18.04 (Azure VM) it looks like it goes through just fine, then when I try to call the cli tool it is not installed. I have it working…
Ben Collier
  • 51
  • 1
  • 6
1
vote
1 answer

How to set up Databricks logs in CLI

Is there an easy way to stream driver logs from Databricks cluster into CLI? I tried Databricks CLI, but found only Event logs. I was thinking about databricks-connect, but never found any details if it is possible to got logs from there. If there…
banest
  • 53
  • 4
1
vote
1 answer

Azure Databricks CLI: update workflow/job definition

I have created a pipeline in Azure DevOps to perform the following three steps: Retrieve the job definition from one Databricks workspace and save it as a json (Databricks CLI config is…
vdvaxel
  • 667
  • 1
  • 14
  • 41
1
vote
1 answer

How can I get secrets from Azure Key Vault from Databricks without creating a Secret Scope?

I'm trying to find a way to get secrets from KV without creating a secret scope OR Create the secret scope automatically using Databricks CLI (following…
Luiz Viola
  • 2,143
  • 1
  • 11
  • 30
1
vote
0 answers

How do I derive the unique object id for a Databricks Notebook based dashboard?

I'm looking to build an automated DevOps pipeline that manages deployment of Azure Databricks notebooks and notebook based dashboards to different environments, as well as distributing the unique URL of the dashboards to business users. The unique…
Richard Carpenter
  • 11
  • 2
1
vote
2 answers

Change run parameters of Databricks python_wheel_task with CLI

I have created a job in DataBricks. Now, I'm trying to run it using databricks cli. See part of the job json: "tasks": [ { "task_key": "task_key", "python_wheel_task": { "package_name": "package_name", …
shalva_t
  • 83
  • 6
1
vote
2 answers

Update Databricks Workspace Repo by Connecting to Databricks CLI with Github Actions

I'm attempting to automatically pull the latest version of a GitHub repo into my Databricks workspace every time a new push is made to the repo. Everything works fine until the Databricks CLI requests the host URL after which it fails with "Error:…
Nick_89
  • 117
  • 2
  • 11
1
vote
0 answers

The changes were made on Databricks repos not displaying in destination branch after merge with main

My work flow is Developer creates a feature branch from main in Databricks repos -> after they make changes on it -> they raise a pull request for merge into main in azure devops-> it triggers the CICD pipeline push the code into the destination…
Harish334363
  • 65
  • 10
1
vote
1 answer

Unable to create Azure-keyvault-backed secret scope on Azure Databricks

I am not able to create secret scope on Azure Databricks from Databricks CLI. I run a command like this: databricks secrets "create-scope" --scope "edap-dev-kv" --scope-backend-type AZURE_KEYVAULT --resource-id…
DejanS
  • 96
  • 9
1
vote
2 answers

dbx databricks deploy named properties

Can anyone provide me a link to an example of using named properties in dbx. The documentation mentions an example of a .json file, https://dbx.readthedocs.io/en/latest/named_properties.html but it does not mention how we can invoke this file with…
Srinivas
  • 2,010
  • 7
  • 26
  • 51
1
2
3 4 5