0

I have a Cloudera (Cloudera Express 5.4.1 (#197 built by jenkins on 20150509-0041 git: 003e06d761f80834d39c3a42431a266f0aaee736)) with Spark installed on it. I want the spark-defaults.conf to have 2 servers defined. How do we carry it out?

spark.eventLog.dir=hdfs://XXXX:8020/user/spark/applicationHistory
spark.eventLog.enabled=true
spark.yarn.historyServer.address=http://XXXX:18088

I want it to be like

spark.eventLog.dir={hdfs://XXXX:8020/user/spark/applicationHistory,hdfs://YYYY:8020/user/spark/applicationHistory}
spark.eventLog.enabled=true
spark.yarn.historyServer.address={http://XXXX:18088, http://YYYY:18088}
James Z
  • 12,209
  • 10
  • 24
  • 44
Divines
  • 11
  • 2

0 Answers0