0

I have developed a Spark Streaming application (which has internal sates as well) with check pointing and fault-tolerant..This is working on when I exit my application and re-reun it...so every thing (states..) loads well,

I wonder why in the case of cluster miss, should it work or not? because I guess Spark save checkpoints as pointers to memory location...

Alex Lipov
  • 13,503
  • 5
  • 64
  • 87
Mahdi
  • 787
  • 1
  • 8
  • 33

1 Answers1

0

Yes it should work, as after cluster up, the state is regained.

Anupam Jain
  • 476
  • 2
  • 6