You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/09/30 15:07:45 UTC

[GitHub] [spark] tgravescs edited a comment on pull request #33941: [WIP][SPARK-36699][Core] Reuse compatible executors for stage-level scheduling

tgravescs edited a comment on pull request #33941:
URL: https://github.com/apache/spark/pull/33941#issuecomment-931402635


   A few other concerns here.
   1) how does this work with minimum executors, seems easiest enough to not worry about it for this and just reuse if there.
   2) how does this apply to executor monitor idle timeout.  we don't timeout executors when more tasks to be run, do we take that into account here and keep compatible ones?
   3) Does UI show proper/useful information here
   4) I don't think this has taken numBarrierSlotsAvailable into account - see calculateAvailableSlots


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org