Stack Overflow
Stack Overflow

Questions tagged [databricks-cli]

67 questions
1
vote
1 answer

Databricks create new job maintaining history

Everytime I created a new job, instead of overwriting the existing one it created a new one with the same name. First thing that came to my mind was to delete all the jobs with a certain name and create the job afterwards. The problem with this is…
Cyzl
  • 13
  • 3
1
vote
1 answer

Import a CSV file using Databricks CLI in Repos

We are using Databricks to generate ETL scripts. One step requires us to upload small csvs into a Repos folder. I can do this manually using the import window in the Repos GUI. However, i would like to do this programmatically using the databricks…
Jongen87
  • 13
  • 2
1
vote
1 answer

Azure Databricks automation databricks-cli authentication issue aad token

I am trying to create data toolchain in automated way. I am using Azure, databricks-cli. https://github.com/Azure-Samples/modern-data-warehouse-dataops/blob/main/e2e_samples/parking_sensors/scripts/deploy_infrastructure.sh I have issue to…
aazure
  • 11
  • 1
  • 3
1
vote
1 answer

Getting job owner from Databricks CLI

I'm trying to obtain the owner of a list of jobs on databricks using CLI. The issue is, the command databricks jobs list doesn't have any information related with that, any suggestions? Thanks in advance!
Marlon Menjivar
  • 33
  • 4
1
vote
1 answer

Deploy repository to new databricks workspace

I am developing my code in a databricks workspace. Using integration with Repos, I use Azure DevOps to version control my code. I would like to use Azure Pipelines to deploy my code to a new test/production environment. To copy the files to the new…
Larsq
  • 315
  • 2
  • 12
1
vote
2 answers

Powershell - JSON string with variables as parameter

I am trying to use Databricks CLI in PowerShell. I need to pass JSON string as parameter. I have two variables - job_id equals to 10 and parameterValue equal to some string. I used like 4 different combinations, but still getting an error of Error:…
romanzdk
  • 930
  • 11
  • 30
1
vote
1 answer

How to read Azure Databricks output using API or class library

I have Azure Databrick notebook which contain SQL command. I need to capture output of SQL command and use in Dot Net core. Need help.
Prashant Rewatkar
  • 11
  • 2
1
vote
1 answer

How to export files generated to Azure DevOps from Azure Databricks after a job terminates?

We are using Azure DevOps to submit a Training Job to Databricks. The training job uses a notebook to train a Machine Learning Model. We are using databricks CLI to submit the job from ADO. In the notebook, in of the steps, we create a .pkl file, we…
Anirban Saha
  • 1,350
  • 2
  • 10
  • 38
1
vote
1 answer

Facing issue while installing Data bricks CLI. Not able to enter Token value at command prompt

I am trying to install Data bricks CLI. At command prompt, I entered command Data bricks configure --token and provided Data bricks Host URL. After entering both values, it's asking value of Token. I have generated token value but it's not allowing…
nidhi sharma
  • 13
  • 2
1
vote
1 answer

Unable to enter Databricks token from Linux/Unbuntu using Databricks Cli

I am trying to authenticate to various tools in Azure using Databricks Cli authentication. I have successfully Databricks Cli using pip3 install databricks-cli. I am running databricks version 0.14.3 I have successfully generated a Databricks token…
Patterson
  • 1,927
  • 1
  • 19
  • 56
1
vote
2 answers

databricks cli dbfs command is is throwing error

I am trying to execute below command in git bash as well as in cmd. However its not working. databricks cli is already installed using pip install databricks-cli installed dbfs rm -r dbfs:/reco/user/feature/branch Error: TypeError: an integer is…
sbs
  • 43
  • 10
1
vote
1 answer

Giving View permission to Databricks jobs using CLI or API

I am creating a Databricks job using CLI. Is it possible to give View permission to my job to another user using Databricks CLI or API? If so, please provide details on how this can be done.
Saravanan
  • 49
  • 6
1
vote
1 answer

Databricks CLI, terminate cluster

I'm reviewing Databricks CLI documentation and cannot find a way to use CLI to terminate the cluster. There are instructions to create, delete, start, etc. but nothing about terminating. Any idea? Thanks!
Tomek
  • 41
  • 4
0
votes
0 answers

"databricks repos update" returns "try logging out of ADD and logging back in"

I am using the new Databricks cli (v0.203.2) With a Databricks PAT, and the workspace URL, I can successfully run commands like: databricks repos list and I see a list of repos However, when I run: databricks repos update, the following is…
Oliver Angelil
  • 1,099
  • 15
  • 31
0
votes
0 answers

Databricks SSl issue. Getting not opening SSL root certificate

i am facing this issue , We need to restart the cluster manually when init script get executed. So that script will get initialized to all the nodes in cluster. That time we don't see the ssl issue.When job starts that time cluster should get…
Varalakshmi Girigowda
  • 1
1 2
3
4 5