Spark implicits do not work on dbutils object

Question

Why cannot I do somthing like this?

import spark.implicits._
dbutils.fs.ls(folderName).toDF

throws an error of

value toDF is not a member of Seq[com.databricks.backend.daemon.dbutils.FileInfo]

But it works fine in databricks notebook. Can anyone advice what I am missing?

I am using the following library "com.databricks" %% "dbutils-api" % "0.0.4"

score 1 · Answer 1 · answered May 05 '20 at 06:52

1

From the relevant Databricks page:

DBUtils are not supported outside of notebooks

answered May 05 '20 at 06:52

Sparker0i

Thanks for your help. I am just creating a jar to be used inside databricks. – Srinivas May 05 '20 at 11:07

1 Answers1