spark-submit error - "Local jar does not exists, skipping"

Asked Nov 30 '22 at 17:11

Active Dec 01 '22 at 13:46

Viewed 91 times

Spark: 3.3.0 (spark-3.3.0-bin-hadoop3)

I am trying to run spark-submit using jar files, but I receive "jar does not exist" from DependencyUtils, even if the JAR is in place. As a consequence the mainClass is not found.

Command: ./spark-submit --class <package-name>.<class-name> <project-path>.jar

The error I am getting:

Error: Failed to load class <package-name>.Application.
INFO ShutdownHookManager: Shutdown hook called

edited Dec 01 '22 at 13:46

OneCricketeer

179,855
19
132
245

asked Nov 30 '22 at 17:11

Jayneel Shah

1

Can you show the full error, in which the `jar does not exist` is included? – Koedlt Nov 30 '22 at 20:43
Show us your class definition and how you're packaging it... Have you tried testing your installation with the Spark examples jar? – OneCricketeer Dec 01 '22 at 13:46

spark-submit error - "Local jar does not exists, skipping"

0 Answers0