Worker nodes out of space due to spark streaming application executors have jar files

Question

My spark streaming application is running in standalone mode, executors which have finished are still holding jar files.

After a couple of days, it starts failing because worker Nodes are going out of space. How can we delete these completed executors?

i think onBatchCompleted is missing in code where it need to release resource — sandeep rawat, Jan 24 '20 at 06:28
You can enable cleanup and reduce cleanup interval. but I think your issue should be due to log files. — Manoj Kumar Dhakad, Jan 24 '20 at 09:50

score 0 · Answer 1 · answered Jan 24 '20 at 09:19

0

add below property in spark-env.sh

export SPARK_WORKER_OPTS="-Dspark.worker.cleanup.enabled=true -Dspark.worker.cleanup.interval=300 -Dspark.worker.cleanup.appDataTtl=60"

answered Jan 24 '20 at 09:19

Nikhil Suthar

1 Answers1