6

I am using a Zeppelin notebook to create a Spark script in Scala.

Code:

def test: DataFrame= {

     //code

}

I am getting the following warning:

warning: there was one deprecation warning; re-run with -deprecation for details.

Any suggestions of how to run the function with "-deprecation"?

PS. I'm not asking about the warning which will require the complete code of the function. I'm looking for suggestions on how to rerun the function with the depreciation parameter in a zeppelin notebook. Existing solutions for this question covers only running in SBT.

Shaido
  • 27,497
  • 23
  • 70
  • 73
data_person
  • 4,194
  • 7
  • 40
  • 75

1 Answers1

2

In the Spark interpreter settings in Zeppelin there is a "args" property that can be set. This corresponds to Spark commandline arguments which is what to change in this case. More infomration about possible configurations can be found in the documentation here.

In short, add "-deprecation" as value for the args property and you will be able to see the details.

Shaido
  • 27,497
  • 23
  • 70
  • 73
  • 1
    Doesn't seem to work by adding "-deprecation" (with or without quotation marks) via the zeppelin ui, in menu [username]->Interpreter->(search for spark)-> edit add -deprecation to args box. Is this what you meant? "warning: there was one deprecation warning; re-run with -deprecation for details" shows in the paragraph regardless with no other information. – cloudsurfin Dec 27 '19 at 05:44