You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/11/12 01:05:58 UTC

[jira] [Assigned] (SPARK-18416) State Store leaks temporary files

     [ https://issues.apache.org/jira/browse/SPARK-18416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-18416:
------------------------------------

    Assignee: Tathagata Das  (was: Apache Spark)

> State Store leaks temporary files
> ---------------------------------
>
>                 Key: SPARK-18416
>                 URL: https://issues.apache.org/jira/browse/SPARK-18416
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Structured Streaming
>    Affects Versions: 2.0.0, 2.0.1, 2.0.2
>            Reporter: Tathagata Das
>            Assignee: Tathagata Das
>             Fix For: 2.1.0
>
>
> StateStore.get() causes temporary files to be created immediately, even if the store is not used to make updates for new version. The temp file is not closed as store.commit() is not called in those cases, thus keeping the output stream to temp file open forever.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org