The standard pyspark progress bar below is supposed to indicate the number of completed and running tasks (A
and B
respectively) out of all C
tasks scheduled for stage X
:
[Stage X:==========> (A + B) / C]
What am I to make of this progress bar then?
[Stage 0:=====> (54288 + -6736) / 65150]
More specifically, what is the meaning of a negative number of running tasks?