Stack Overflow
Stack Overflow

Questions tagged [databricks-rest-api]

For questions around Databricks REST APIs that are used for automation of Databricks.

Databricks REST APIs are used to work with Databricks from the code - CI/CD, deployment, ... These APIs are the base for all other tools - Databricks CLI, Databricks Terraform Provider, etc.

31 questions
1
vote
2 answers

Databricks Jobs API "INVALID_PARAMETER_VALUE" when trying to get job

I'm just starting to explore the Databricks API. I've created a .netrc file as described in this doc and am able to get the API to work with this for other operations like "list clusters" and "list jobs". But when I try to query details of a…
hyperwiser
  • 437
  • 1
  • 5
  • 19
1
vote
1 answer

Is it possible to run a cell of a databricks notebook via REST API?

I would like to run a notebook cell automatically via REST API to make the usability of a dev tool we created better. Is that possible in databricks?
Jean Carlo Machado
  • 1,480
  • 1
  • 15
  • 25
1
vote
1 answer

Assign different cluster to existing jobs on azure databricks before running it

I am running auto jobs for training models using databricks-api on Azure Databricks clusters. My script checks cluster, if it doesn't exist script would create a new one else it would return the id of the existing one. after that, my script checks…
irum zahra
  • 417
  • 1
  • 8
  • 17
1
vote
1 answer

Dynamically insert a command into an existing notebook in Databricks

Off the back this great answer in this post: Create a notebook inside another notebook in Databricks Dynamically using Python where it was shown how to create an entirely new notebook dynamically, my question is on inserting a command into an…
Mikee
  • 783
  • 1
  • 6
  • 18
1
vote
1 answer

Azure Databricks API

Trying to use the Databricks API to work with resources programmatically. I am using this microsoft documentto authenticate with a service…
RealisticMagician
  • 37
  • 2
0
votes
0 answers

Databricks - workspace import file api caused a file already exists exception

I'm working on Databricks API that upload a notebook file from local with following api call In normal behavior this code work just fine. There are some cased that if test.py already in the workspace but with different a language property e.g. SQL.…
Jirapong
  • 24,074
  • 10
  • 54
  • 72
0
votes
1 answer

Databricks Api: set Permissions for all Repos

The databricks docu allows to set permissions for specific repos such as: PATCH /api/2.0/permissions/repos/{RepoID} I would now set the permissions for all Repos. How can I do that? Simply removing the repoID leads to an error, in the UI it is…
user3579222
  • 1,103
  • 11
  • 28
0
votes
1 answer

Set Databricks Permissions via API

The Databricks spec introduces how to create permissions via an REST API. There, two path parameters are described: request_object_type, request_object_id. Unfortunately no examples are given for them. Where/How do I get those parameters from…
user3579222
  • 1,103
  • 11
  • 28
0
votes
2 answers

Azure Databricks notebook not picking the parameters passed via job api

Flask application --> Capturing the value entered via web form and passing it as a parameter to trigger a databricks job. Tried passing the parameters as follows : 1- payload = { > 'notebook_params': { > 'customer_name':…
Tauqeer Khan
  • 1
  • 1
0
votes
0 answers

how to make Azure Databricks RunsApi run faster

In a local python file, I am using the databricks RunsApi to call a notebook in databricks and then return the response as a Json. When I run the notebook in databricks directly, it only takes about 3 seconds to run, but using the api is taking 25…
J. Doe
  • 165
  • 5
  • 16
0
votes
1 answer

how to call databricks notebook from python using rest api

I want to create a python notebook on my desktop that pass an input to another notebook in databricks, and then return the output of the databricks notebook. For example, my local python file will pass a string into a databricks notebook, which will…
J. Doe
  • 165
  • 5
  • 16
0
votes
0 answers

How to update databricks specific tasks using API

I would like to update databricks multi-task format in job using API endpoint through Python code.I am using this document for reference https://docs.databricks.com/dev-tools/api/latest/jobs.html#operation/JobsUpdate If I want to update…
codingtest
  • 1
0
votes
1 answer

Databricks REST API: move Repo to Workspace Folder

I am using the Python Databricks REST API. I create folder in the workspace: workspace_api = WorkspaceApi(api_client) workspace_api.mkdirs("/Users/xxxx/myfirstrepo") Then, I checkout a repo: repos_api =…
user3579222
  • 1,103
  • 11
  • 28
0
votes
2 answers

How to create Azure Databricks job of type python wheel by using Azure databricks API

I would like to create a databricks job of type "python wheel" in Azure by using databricks API. I have a python wheel that I need to execute in this job. This question is related to my other question at this stackoverflow link, just the technology…
E. Erfan
  • 1,239
  • 19
  • 37
0
votes
1 answer

Databricks Install Libraries through Libraries API is not working

I'm trying to install libraries using this api: https:///api/2.0/libraries/install/ Here is the body: { "cluster_id": "", "libraries": [ { "pypi": { "package": "cryptography==3.4.7" …
Sandy
  • 17
  • 2
1
2
3