You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Vineet Garg (JIRA)" <ji...@apache.org> on 2018/06/27 18:31:03 UTC
[jira] [Updated] (HIVE-16041) HCatalog doesn't delete temp
_SCRATCH dir when job failed
[ https://issues.apache.org/jira/browse/HIVE-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vineet Garg updated HIVE-16041:
-------------------------------
Fix Version/s: (was: 3.1.0)
3.2.0
Deferring this to 3.2.0 since the branch for 3.1.0 has been cut off.
> HCatalog doesn't delete temp _SCRATCH dir when job failed
> ----------------------------------------------------------
>
> Key: HIVE-16041
> URL: https://issues.apache.org/jira/browse/HIVE-16041
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
> Affects Versions: 2.2.0
> Reporter: yunfei liu
> Assignee: yunfei liu
> Priority: Major
> Fix For: 3.2.0
>
> Attachments: HIVE-16041.1.patch, HIVE-16041.2.patch, HIVE-16041.3.patch
>
>
> when we use HCatOutputFormat to write to an external partitioned table, a tmp dir (which starts with "_SCRATCH" ) will appear under table path if the job failed.
> {quote}
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:45 /tmp/hive/_SCRATCH0.31946356159329714
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:51 /tmp/hive/_SCRATCH0.31946356159329714/c1=1
> drwxr-xr-x - yun hdfs 0 2017-02-27 00:57 /tmp/hive/c1=1
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:28 /tmp/hive/c1=1/c2=2
> -rw-r--r-- 3 yun hdfs 12 2017-02-27 00:57 /tmp/hive/c1=1/c2=2/part-r-00000
> -rw-r--r-- 3 yun hdfs 12 2017-02-27 01:28 /tmp/hive/c1=1/c2=2/part-r-00000_a_1
> {quote}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)