You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2020/10/23 08:10:59 UTC

[GitHub] [spark] yeshengm commented on pull request #24595: [SPARK-20774][SPARK-27036][SQL] Cancel the running broadcast execution on BroadcastTimeout

yeshengm commented on pull request #24595:
URL: https://github.com/apache/spark/pull/24595#issuecomment-715140507


   @jiangxb1987 Just out of curiosity, the timeout mechanism was added because we have no way to track the lineage of such broadcast sub job right? Even if the "main" RDD action was cancelled, these broadcast jobs running in other threads will just keep running until it fails or timed out (which was added in this diff).


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org