Uninstall Databricks Connect in CI/CD Pipeline

Question

I have a CI/CD pipeline (with a self-hosted Agent), where I first install databricks-connect and then set the configuration.

  - script: |
      pip install --upgrade --force-reinstall databricks-cli
      pip install --upgrade --force-reinstall databricks-connect==10.4.*
    displayName: 'pip installs'

  - script: |
      echo "${{ variables.X}}
      $(Y)
      ${{ variables.Z}}
      ${{ variables.K}}
      ${{ variables.N}}" | databricks-connect configure
    displayName: 'conf'

However, even after successfully re-installing databricks connect, the second step seem to remember the configuration (so when re-running the pipeline, it seems like it still remembers the configuration):

The current configuration is:
* Databricks Host: x
* Databricks Token: y
* Cluster ID: z
* Org ID: d
* Port: 15001

How can I uninstall databricks-connect and remove all the configuration so that each run is like a new one?

My problem is the following: if I get a new Agent, I have to pass an additional y parameter to confirm the license agreement while this parameter is not required when the databricks connect is already configured (see here for an example):

  - script: |
      echo "y
      ${{ variables.X}}
      $(Y)
      ${{ variables.Z}}
      ${{ variables.K}}
      ${{ variables.N}}" | databricks-connect configure
    displayName: 'conf'

Uninstall Databricks Connect in CI/CD Pipeline

0 Answers0