You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/11/14 12:40:59 UTC

[jira] [Updated] (SPARK-18416) State Store leaks temporary files

     [ https://issues.apache.org/jira/browse/SPARK-18416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen updated SPARK-18416:
------------------------------
    Target Version/s: 2.1.0
       Fix Version/s:     (was: 2.1.0)

> State Store leaks temporary files
> ---------------------------------
>
>                 Key: SPARK-18416
>                 URL: https://issues.apache.org/jira/browse/SPARK-18416
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Structured Streaming
>    Affects Versions: 2.0.0, 2.0.1, 2.0.2
>            Reporter: Tathagata Das
>            Assignee: Tathagata Das
>
> StateStore.get() causes temporary files to be created immediately, even if the store is not used to make updates for new version. The temp file is not closed as store.commit() is not called in those cases, thus keeping the output stream to temp file open forever.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org