[jira] [Updated] (SPARK-26774) Document threading concerns in TaskSchedulerImpl

["Imran Rashid (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-26774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Imran Rashid updated SPARK-26774:
---------------------------------
    Description: TaskSchedulerImpl has a couple of places threading concerns aren't clearly documented, which could improved a little.  There is also a race in {{killTaskAttempt}} on {{taskIdToExecutorId}} (though I think nobody actually uses this api).  (was: TaskSchedulerImpl has a bunch of threading concerns, which are not well documented -- in fact the docs it has are somewhat misleading.  In particular, some of the methods should only be called within the DAGScheduler event loop.

This suggests some potential refactoring to avoid so many mixed concerns inside TaskSchedulerImpl, but that's a lot harder to do safely, I just want to add some comments.)

> Document threading concerns in TaskSchedulerImpl
> ------------------------------------------------
>
>                 Key: SPARK-26774
>                 URL: https://issues.apache.org/jira/browse/SPARK-26774
>             Project: Spark
>          Issue Type: Improvement
>          Components: Scheduler, Spark Core
>    Affects Versions: 3.0.0
>            Reporter: Imran Rashid
>            Priority: Major
>
> TaskSchedulerImpl has a couple of places threading concerns aren't clearly documented, which could improved a little.  There is also a race in {{killTaskAttempt}} on {{taskIdToExecutorId}} (though I think nobody actually uses this api).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org