You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Genmao Yu (JIRA)" <ji...@apache.org> on 2017/01/25 01:23:26 UTC

[jira] [Closed] (SPARK-19343) Do once optimistic checkpoint before stop

     [ https://issues.apache.org/jira/browse/SPARK-19343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Genmao Yu closed SPARK-19343.
-----------------------------
    Resolution: Won't Fix

> Do once optimistic checkpoint before stop
> -----------------------------------------
>
>                 Key: SPARK-19343
>                 URL: https://issues.apache.org/jira/browse/SPARK-19343
>             Project: Spark
>          Issue Type: Improvement
>          Components: DStreams
>    Affects Versions: 2.0.2, 2.1.0
>            Reporter: Genmao Yu
>
> Streaming job restarts from checkpoint, and it will rebuild several batch until finding latest checkpointed RDD. So we can do once optimistic checkpoint just before stop, so that reducing unnecessary recomputation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org