1

I'm trying to submit a Spark batch job using Apache Livy. I am running my Spark cluster and Livy service on Openshift. the Spark cluster is in standalone cluster mode, Livy runs spark in cluster deploy mode. I've configured Livy to the Spark cluster master service:

livy.spark.master = "spark://spark.spark.svc:7077

when i try to run a scala spark job, using the POST /batches method and get the exception:

Unable to connect to server spark://spark.spark.svc:7077

Anyone experienced this issue?

Mahesh Waghmare
  • 726
  • 9
  • 27

0 Answers0