databricks cli dbfs command is is throwing error

Question

I am trying to execute below command in git bash as well as in cmd. However its not working. databricks cli is already installed using pip install databricks-cli installed

dbfs rm -r dbfs:/reco/user/feature/branch Error: TypeError: an integer is required (got type bytes)

what version of databricks-cli, and python? – Alex Ott Oct 04 '20 at 16:49 — Alex Ott, Oct 04 '20 at 16:49
python -3.8, databricks cli- Version 0.11.0 – sbs Oct 05 '20 at 19:21 — sbs, Oct 05 '20 at 19:21

Alex Ott · Answer 1 · 2020-10-06T09:42:58.227

1

It's a known issue with Python 3.8, workaround is to use Python 3.7 or to uninstall pyspark 2.4.x that it's incompatible with Python 3.8 anyway...

edited Oct 06 '20 at 09:42

answered Oct 06 '20 at 09:36

Alex Ott

80,552
8
87
132

uninstalling pyspark 3 worked for me. I am still using python 3.8.5 so looks like issue was after installing pyspark 3 – sbs Oct 07 '20 at 10:46
Hmmm, I run with pyspark 3 and didn't have this problem - it was only with Spark 2.4. Can you add your comment to the Github issue that I linked? – Alex Ott Oct 07 '20 at 11:37

score 0 · Accepted Answer · answered Nov 17 '20 at 14:29

0

uninstalling pyspark 3 worked for me. I am still using python 3.8.5 so looks like issue was after installing pyspark 3

answered Nov 17 '20 at 14:29

sbs

43
10

databricks cli dbfs command is is throwing error

2 Answers2