You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "lufei (JIRA)" <ji...@apache.org> on 2017/08/25 01:27:00 UTC
[jira] [Comment Edited] (SPARK-21822) When insert Hive Table is
finished, it is better to clean out the tmpLocation dir
[ https://issues.apache.org/jira/browse/SPARK-21822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141030#comment-16141030 ]
lufei edited comment on SPARK-21822 at 8/25/17 1:26 AM:
--------------------------------------------------------
I'm so sorry for close this issue by mistake,so I reopen it.
was (Author: figo):
I close this issue by mistake.
> When insert Hive Table is finished, it is better to clean out the tmpLocation dir
> ---------------------------------------------------------------------------------
>
> Key: SPARK-21822
> URL: https://issues.apache.org/jira/browse/SPARK-21822
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: lufei
> Priority: Minor
>
> When insert Hive Table is finished, it is better to clean out the tmpLocation dir(the temp directories like ".hive-staging_hive_2017-08-19_10-56-01_540_5448395226195533570-9/-ext-10000" or "/tmp/hive/..." for an old spark version).
> Otherwise, when lots of spark job are executed, millions of temporary directories are left in HDFS. And these temporary directories can only be deleted by the maintainer through the shell script.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org