I think it is implied from the system diagram that sparkling water implemented worker to worker direct communication (without going back to the master). Can someone point out where is the code is that feature?
Asked
Active
Viewed 78 times
0
-
As per i understand you question. you need to share your code with all cluster node without submitting jar right ? – Uttam Kasundara Jul 25 '16 at 10:02
1 Answers
0
Sparkling Water is using the exact same communication pattern as Spark does. The driver starts the computation and orchestrates the work amongst several worker nodes. Sparkling Water is basically just Spark application with H2O node running in each Spark's JVM ( for all executors and driver )
Jakub Háva
- 228
- 1
- 5