[jira] [Commented] (SPARK-22577) executor page blacklist status should update with TaskSet level blacklisting

["Imran Rashid (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-22577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16298838#comment-16298838 ] 

Imran Rashid commented on SPARK-22577:
--------------------------------------

[~tgraves] what exactly were you thinking?

I remember when first looking at this I wasn't really sure what to show within a taskset -- from my experience, whenever you have a bad taskset, which eventually fails, you end up getting a bunch of executor blacklisting.  This is totally fine, but I worried about loudly warning, as it would be misleading -- the users would think the issue was bad executors, when in fact its just a bad taskset.

I'm guessing you want this to show up in the stage UI -- what did you have in mind?

> executor page blacklist status should update with TaskSet level blacklisting
> ----------------------------------------------------------------------------
>
>                 Key: SPARK-22577
>                 URL: https://issues.apache.org/jira/browse/SPARK-22577
>             Project: Spark
>          Issue Type: Bug
>          Components: Scheduler
>    Affects Versions: 2.1.1
>            Reporter: Thomas Graves
>
> right now the executor blacklist status only updates with the BlacklistTracker after a task set has finished and propagated the blacklisting to the application level. We should change that to show at the taskset level as well. Without this it can be very confusing to the user why things aren't running.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org