1

I'm submitting a batch Job, the Pi Job, with a curl command to Livy , but it fails because the java.lang.ClassNotFoundException: org.apache.livy.Job. If I compile my jar with all the dependencies inside the jar file then it works.

Why do I need to do that? I'm executing it on Livy, at least I expect Livy have it's owns dependencies available.

José Carlos Guevara Turruelles
  • 481
  • 8
  • 23

1 Answers1

0

Livy simulate spark submit in nature use SparkLauncher, so you jar should be fatJar,include all dependency.

Pookly
  • 103
  • 2
  • 15