3

I'm wondring which protocol Apache Zeppelin is using to connect to Apache Spark?

Is it also the iPython Protocol on ZeroMQ?

Thanks a lot!

best regards

Romeo

Romeo Kienzler
  • 3,373
  • 3
  • 36
  • 58

1 Answers1

3

Spark Interpreter for Apache Zeppelin (incubating) actually uses neither of them.

It just hosts Spark Driver inside spark interpreter process and submits a job per paragraph though SparkIMain, in the same way as spark-shell does.

I believe an internal low-level communication between Driver and Master is based on Akka but is a Spark-specific implementation detail.

bzz
  • 663
  • 3
  • 12
  • Just found this link here, where somebody created a Scala Library for hiding the Akka complexity, also has a nice architecture diagram: http://www.spark.tc/overview-of-the-spark-kernel-client-library/ – Romeo Kienzler Sep 14 '15 at 20:55