You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Vaibhav Kulkarni <va...@gmail.com> on 2021/10/06 10:44:06 UTC

Question on Broadcast Exchange Stages execution time

Hi,

I am executing a TPCDS query using ADE (Adaptive Query Execution). The
query has 2 broadcast Exchange stage. I notice one Broadcast Exchange stage
show collect time 1.5min and other stage shows collect time 375ms. But,
interestingly, both the stages shows same data size of 16B, even the number
of rows is 1 for both stages. The attached screenshot shows that. I am
trying to understand why one stage shows 1.5mins and other stage shows
375ms. Anyone knows why this discrepancy ?

Thanks,
Vaibhav M Kulkarni