You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "liupengcheng (JIRA)" <ji...@apache.org> on 2019/01/14 11:23:00 UTC
[jira] [Updated] (SPARK-26614) Speculation kill might cause job
failure
[ https://issues.apache.org/jira/browse/SPARK-26614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
liupengcheng updated SPARK-26614:
---------------------------------
Description:
This issue is similar to SPARK-26612
Some odd exceptions might be thrown in speculation kill, however, currently spark does not handle this case and will report failure to Driver. This exception will be counting towards MAX_TASK_FAILURES, and might result in the job failure.
I think we can check state of task to tell if we report failure or killed.
was:
This issue is similar to[SPARK-26612|[http://issues.apache.org/jira/browse/SPARK-26612]]
Some odd exceptions might be thrown in speculation kill, however, currently spark does not handle this case and will report failure to Driver. This exception will be counting towards MAX_TASK_FAILURES, and might result in the job failure.
I think we can check state of task to tell if we report failure or killed.
> Speculation kill might cause job failure
> ----------------------------------------
>
> Key: SPARK-26614
> URL: https://issues.apache.org/jira/browse/SPARK-26614
> Project: Spark
> Issue Type: Bug
> Components: Scheduler, Spark Core
> Affects Versions: 2.1.0
> Reporter: liupengcheng
> Priority: Major
>
> This issue is similar to SPARK-26612
> Some odd exceptions might be thrown in speculation kill, however, currently spark does not handle this case and will report failure to Driver. This exception will be counting towards MAX_TASK_FAILURES, and might result in the job failure.
>
> I think we can check state of task to tell if we report failure or killed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org