You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Albert Cheng (JIRA)" <ji...@apache.org> on 2016/12/07 04:39:58 UTC

[jira] [Created] (SPARK-18759) when use spark streaming with sparksql, lots of temp directories are created.

Albert Cheng created SPARK-18759:
------------------------------------

             Summary: when use spark streaming with sparksql, lots of temp directories are created.
                 Key: SPARK-18759
                 URL: https://issues.apache.org/jira/browse/SPARK-18759
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.0.2
            Reporter: Albert Cheng


When use spark streaming with sparksql to insert records into existed hive table. there are lots of temp directories created. Those directories are deleted only when jvm exits. But if using sparksql with spark streaming, jvm will work 7*24 hours.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org