[jira] [Updated] (SPARK-6414) Spark driver failed with NPE on job cancelation

["Josh Rosen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Josh Rosen updated SPARK-6414:
------------------------------
    Assignee: Hung Lin

> Spark driver failed with NPE on job cancelation
> -----------------------------------------------
>
>                 Key: SPARK-6414
>                 URL: https://issues.apache.org/jira/browse/SPARK-6414
>             Project: Spark
>          Issue Type: Bug
>          Components: Scheduler
>    Affects Versions: 1.2.1, 1.3.0
>            Reporter: Yuri Makhno
>            Assignee: Hung Lin
>            Priority: Critical
>             Fix For: 1.2.2, 1.3.1, 1.4.0
>
>
> When a job group is cancelled, we scan through all jobs to determine which are members of the group. This scan assumes that the job group property is always set. If 'properties' is null in an active job, you get an NPE.
> We just need to make sure we ignore ones where activeJob.properties is null. We should also make sure it works if the particular property is missing.
> https://github.com/apache/spark/blob/branch-1.3/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala#L678



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org