i am trying to alter the delta table using spark sql query in java code. but when i am excuting my jar at cluster i am getting error like : org.spark_project.guava.util.concurrent.ExecutionError: java.lang.NoClassDefFoundError: org/apache/spark/sql/connector/catalog/TableProvider
Asked
Active
Viewed 2,929 times
0
-
check if the spark sql library in your jar file. if not change (or remove the "provided" build scope from f.e. maven. If you do not use maven, tell us which build tool you use. – eckad158 Mar 11 '22 at 09:15
-
yes i have that in my pom – Yogesh Mar 11 '22 at 10:07
-
remove the scope tag from the pom file. Maven should then package the libary into the jar file. – eckad158 Mar 11 '22 at 10:20
-
How do you run the Spark app? How do you run the query? Edit your question and add the answers. Thank you. – Jacek Laskowski Mar 13 '22 at 20:22