-2

Team,

Installed CDH 5.13 version on my local computer and doing upgrade from spark 1.6 to spark 2.0. is it possible to do run spark application using yarn mode. Please confirm . or it will work as standalone mode.

Learn Hadoop
  • 2,760
  • 8
  • 28
  • 60

2 Answers2

3

Yes. Both modes are supported.

From CDH 6.x Stand Alone is no longer supported.

thebluephantom
  • 16,458
  • 8
  • 40
  • 83
  • I tried in my CDH version (Cloudera Expression 5.13.0).. Getting bellow exception while adding * The CSD version (2.2.0.cloudera2) is not compatible with the current * Spark 2 version (). Either update your CSD or * make sure you have the correct Spark version installed and * activated. ********** – Learn Hadoop Apr 08 '19 at 19:37
  • Add this jar : SPARK2_ON_YARN-2.2.0.cloudera2.jar . Am i added right jar ..? if not can you please suggest me right jar to download – Learn Hadoop Apr 08 '19 at 19:38
  • Your question was if supported. These are different questions. If for learning purposes use a VM with 2.x already installed. – thebluephantom Apr 08 '19 at 20:16
  • @thebluephantom - I recently downloaded quickstart VM of Cloudera (5.13). But I didn't find Spark 2 already present in it. I had to manually install it using the CSD of Spark2 – Prashant May 28 '19 at 10:21
  • That’s why I use mapr. – thebluephantom May 28 '19 at 10:49
2

YARN supports stand alone mode and cluster mode. I have used both of them and they work fine on Cloudera 5.11 + Spark2 setup.

Prashant
  • 702
  • 6
  • 21