0

When I spark-submit an application to run with apache mesos, it does not recognize the properties below at all and code returns null that reads them.

--conf spark.driver.extraJavaOptions=-Dsome.url=http://some-url 
--conf spark.executor.extraJavaOptions=-Dsome.url=http://some-url

tried option here

and still got no change in the result.

Any idea how to supply system properties in mesos.

Community
  • 1
  • 1
sc so
  • 303
  • 1
  • 5
  • 13
  • What are you trying to accomplish? extraJavaOptions are typically used for JVM related parameters and they have specific names. – Ayan Guha Sep 20 '16 at 01:19
  • spark.driver.extraJavaOptions can be used to set and pass any System properties. In Yarn I am able to access it fine. It is just Mesos where I am experiencing this difficulty. – sc so Sep 20 '16 at 16:02

0 Answers0