Re: [PR] [SPARK-54088][CORE] When TaskSchedulerImpl searches for an executor to schedule an unschedulable task, it should exclude executors that are pending to remove [spark]

["Ngone51 (via GitHub)" <gi...@apache.org>]

Ngone51 commented on code in PR #52793:
URL: https://github.com/apache/spark/pull/52793#discussion_r2664019317


##########
core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala:
##########
@@ -164,6 +164,8 @@ private[spark] class TaskSchedulerImpl(
   // in turn is used to decide when we can attain data locality on a given host
   protected val hostToExecutors = new HashMap[String, HashSet[String]]
 
+  protected val availableHostsToExecutors = new HashMap[String, HashSet[String]]

Review Comment:
   Why not update `hostToExecutors` directly? Why do we need a separate `availableHostsToExecutors`?



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org