Stack Overflow
Stack Overflow

Questions tagged [databricks-cli]

67 questions
0
votes
0 answers

Can't add user to scope in databricks - User or group doesn't exist

I'm trying to add a user to a scope using the databricks CLI databricks secrets put-acl --scope --principal --permission MANAGE Although the user has access to the workspace and has been using it (and there is…
Sanchez333
  • 318
  • 3
  • 11
0
votes
1 answer

Databricks CLI copy command not copying folder but copied only files

I use Azure databricks and databricks CLI to manage it. When I try to copy some local folders and files to databricks DBFS, at first folder it copied with folder and files ( as same as local ). But for the second folders, it just copied files in it…
Akash
  • 29
  • 8
0
votes
0 answers

Unable to access external location in Databricks on AWS

I'm unable to access one particular external location in Databricks on AWS using the databricks cli databricks unity-catalog external-locations get --name returns Error: Authorization failed. Your token may be expired or lack the valid…
gary69
  • 3,620
  • 6
  • 36
  • 50
0
votes
0 answers

Clone a Private Repo via Databricks CLI

I have a private Repo on Azure Dev. There I run a Python script where I use the ReposApi .... repos_api=ReposApi(api_lcient) repos_api.create("https://xxx:token@host..") Even when adding the token to the url, I get an error: 403 Client…
user3579222
  • 1,103
  • 11
  • 28
0
votes
0 answers

Python DatabricksCLI: get_run always fails

I am using the Job_Service API of databricks job={"run_name":"Pythonjob","existing_cluster_id": "xxx","notebook_task":{"notebook_path":…
user3579222
  • 1,103
  • 11
  • 28
0
votes
1 answer

Databricks REST API: move Repo to Workspace Folder

I am using the Python Databricks REST API. I create folder in the workspace: workspace_api = WorkspaceApi(api_client) workspace_api.mkdirs("/Users/xxxx/myfirstrepo") Then, I checkout a repo: repos_api =…
user3579222
  • 1,103
  • 11
  • 28
0
votes
1 answer

Cannot create Repo with Databricks CLI

I am using Azure DevOps and Databricks. I created a simplified CI/CD Pipeline which triggers the following Python script: existing_cluster_id = 'XXX' notebook_path = './' repo_path = '/Repos/abc@def.at/DevOpsProject' git_url =…
user3579222
  • 1,103
  • 11
  • 28
0
votes
0 answers

Configure YAML Pipeline to run databricks repos update Error:JSONDecodeError

I am trying to configure a devops pipeline to get Databricks workspace to automatically pull the latest version of the repo when master branch is updated. I am able to generate the DB_PAT but I cannot seem to get this into the DATABRICKS_TOKEN…
soiryk139
  • 51
  • 6
0
votes
0 answers

Spyder Console databricks not defined error

In anaconda spyder, I installed databricks-cli as below pip install databricks-cli After installation in c:\programdata\anaconda3\Scripts, databricks.exe is showing up; but, when I run command (databricks -version), it displays below…
Syed Mohammed Mehdi
  • 183
  • 2
  • 5
  • 15
0
votes
1 answer

Databricks CLI to list or fetch the job run history of status

I am looking for some options either using databricks cli or Databricks notebook code to get the list of the job execution. with the databricks job get --job-id --profile=dbspace-1, lists the metadata info of the job not the historic info…
Tim
  • 1,321
  • 1
  • 22
  • 47
0
votes
1 answer

Prevent Databricks cluster creation in Standard SKU

We're in Databricks Standard SKU, in standard SKU, there is no access control and every users are admin, due to which everybody has previlage to create there own cluster. Is there a way we can restrict the cluster creation for databricks users in…
Anil Kumar
  • 525
  • 6
  • 27
0
votes
2 answers

Append dynamic multiple lines header in to an .txt file which as data from data bricks

I am trying to load data in to a abc.txt file form an .csv file which is stored in delta lake. Example : Data load with | separation in abc.txt file id|name|address|contact_no 1|abc|xyz1|123 2|efg|xyz2|456 3|hij|xyz3|789 4|klmn|xyz4|91011 Header…
Sai Kiran
  • 1
  • 1
0
votes
1 answer

How to find creation date of databricks interactive cluster?

Is there a way to know creation date of databricks interactive cluster ? I looked at configuration tab as well as JSON of ARM but couldn't find it..
Learn2Code
  • 107
  • 1
  • 11
0
votes
1 answer

Copy data from Azure databricks to AWS Ec2

I am new to Azure Databricks. I want to copy data from azure databricks to one of my aws ec2 instance. can anyone please help me in doing this? Thanks in advance!
Rocky
  • 75
  • 1
  • 1
  • 7
0
votes
1 answer

Databricks cli authentication failed

I executed databricks configure --token command and correspondingly i put my host id and token (multiple times) But when i try to execute databricks clusters list command it gives me error: Error: b'Bad Request'. Can anyone suggest solution to…
Lalit Naagar
  • 1
  • 1
1 2 3
4
5