You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2016/12/07 07:27:58 UTC

[jira] [Closed] (SPARK-18759) when use spark streaming with sparksql, lots of temp directories are created.

     [ https://issues.apache.org/jira/browse/SPARK-18759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Liang-Chi Hsieh closed SPARK-18759.
-----------------------------------
    Resolution: Duplicate

duplicate to SPARK-18703

> when use spark streaming with sparksql, lots of temp directories are created.
> -----------------------------------------------------------------------------
>
>                 Key: SPARK-18759
>                 URL: https://issues.apache.org/jira/browse/SPARK-18759
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.0.2
>            Reporter: Albert Cheng
>
> When use spark streaming with sparksql to insert records into existed hive table. there are lots of temp directories created. Those directories are deleted only when jvm exits. But if using sparksql with spark streaming, jvm will work 7*24 hours.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org