You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tathagata Das (JIRA)" <ji...@apache.org> on 2018/01/17 21:54:01 UTC

[jira] [Resolved] (SPARK-23033) disable task-level retry for continuous execution

     [ https://issues.apache.org/jira/browse/SPARK-23033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tathagata Das resolved SPARK-23033.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: 2.3.0
                   3.0.0

Issue resolved by pull request 20225
[https://github.com/apache/spark/pull/20225]

> disable task-level retry for continuous execution
> -------------------------------------------------
>
>                 Key: SPARK-23033
>                 URL: https://issues.apache.org/jira/browse/SPARK-23033
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Structured Streaming
>    Affects Versions: 2.3.0
>            Reporter: Jose Torres
>            Priority: Major
>             Fix For: 3.0.0, 2.3.0
>
>
> Continuous execution tasks shouldn't retry independently, but rather use the global restart mechanism. Retrying will execute from the initial offset at the time the task was created, which is very bad.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org