WholeStageCodegen’s min duration larger than the query duration

Asked Jul 04 '23 at 17:53

Active Jul 05 '23 at 20:06

Viewed 31 times

I found in the spark ui, the duration of the min time of the WholeStageCodegen part larger than the duration of the query. I think that does not make sense right?

Now, I want to examine the where does those total, min, max were calculated in the Spark 3.1 version.

Could anyone give me some guidance? Any help will be appreciated.

edited Jul 05 '23 at 20:06

asked Jul 04 '23 at 17:53

user17118231

Could you provide a larger screenshot with what's above the "6s" info? Also keep in mind that the time is distributed among several workers. – Gaël J Jul 04 '23 at 19:23
Yes, but above the 6s, there is just shows the submitted time – user17118231 Jul 05 '23 at 20:04

WholeStageCodegen’s min duration larger than the query duration

0 Answers0