You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gabor Somogyi (JIRA)" <ji...@apache.org> on 2019/05/06 12:09:00 UTC
[jira] [Comment Edited] (SPARK-27634) deleteCheckpointOnStop should
be configurable
[ https://issues.apache.org/jira/browse/SPARK-27634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16833743#comment-16833743 ]
Gabor Somogyi edited comment on SPARK-27634 at 5/6/19 12:08 PM:
----------------------------------------------------------------
[~yuwang0917@gmail.com] I think in such case one should use temporary checkpoint location. In Spark 3.0 this can be force deleted with "spark.sql.streaming.forceDeleteTempCheckpointLocation".
was (Author: gsomogyi):
[~yuwang0917@gmail.com] I think one should use temporary checkpoint location. In Spark 3.0 this can be force deleted with "spark.sql.streaming.forceDeleteTempCheckpointLocation".
> deleteCheckpointOnStop should be configurable
> ---------------------------------------------
>
> Key: SPARK-27634
> URL: https://issues.apache.org/jira/browse/SPARK-27634
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 2.4.2
> Reporter: Yu Wang
> Priority: Minor
> Attachments: SPARK-27634.patch
>
>
> we need to delete checkpoint file after running the stream application multiple times, so deleteCheckpointOnStop should be configurable
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org