2

https://docs.databricks.com/dev-tools/databricks-utils.html

I am trying to use dbutils.fs.rm in a job for Azure on a dbfs folder. It's actually a big pain and the dbutils.fs.rm resolves all the issues but seems to only work in a notebook.

The issues I am having are dealing with sub folders with files. I want an easy way within python to delete all a folder, and all sub content.

Alex Ott
  • 80,552
  • 8
  • 87
  • 132
Brian
  • 848
  • 10
  • 32
  • Can you use an azure function? – Luiz Viola Sep 15 '22 at 12:11
  • Does this answer your question? [Custom python module in azure databricks with spark/dbutils dependencies](https://stackoverflow.com/questions/71420828/custom-python-module-in-azure-databricks-with-spark-dbutils-dependencies) – Alex Ott Sep 22 '22 at 08:02
  • sadly if I had access, I would. my guess is that there is a sync or cache situation going on. – Brian Oct 20 '22 at 18:52

0 Answers0