You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "yunfei liu (JIRA)" <ji...@apache.org> on 2017/02/26 15:05:45 UTC
[jira] [Updated] (HIVE-16041) HCatalog doesn't delete temp
_SCRATCH dir when job failed
[ https://issues.apache.org/jira/browse/HIVE-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
yunfei liu updated HIVE-16041:
------------------------------
Description:
when we use HCatOutputFormat to write to an external partitioned table, a tmp dir (which starts with "_SCRATCH" ) will appear under table path if the job failed.
{quote}
drwxr-xr-x - yun hdfs 0 2017-02-27 01:45 /tmp/hive/_SCRATCH0.31946356159329714
drwxr-xr-x - yun hdfs 0 2017-02-27 01:51 /tmp/hive/_SCRATCH0.31946356159329714/c1=1
drwxr-xr-x - yun hdfs 0 2017-02-27 00:57 /tmp/hive/c1=1
drwxr-xr-x - yun hdfs 0 2017-02-27 01:28 /tmp/hive/c1=1/c2=2
-rw-r--r-- 3 yun hdfs 12 2017-02-27 00:57 /tmp/hive/c1=1/c2=2/part-r-00000
-rw-r--r-- 3 yun hdfs 12 2017-02-27 01:28 /tmp/hive/c1=1/c2=2/part-r-00000_a_1
{quote}
was:
when we use HCatOutputFormat to write to an external partitioned table, a tmp dir (which starts with "_SCRATCH" ) will appear under table path if the job failed.
> HCatalog doesn't delete temp _SCRATCH dir when job failed
> ----------------------------------------------------------
>
> Key: HIVE-16041
> URL: https://issues.apache.org/jira/browse/HIVE-16041
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
> Affects Versions: 2.2.0
> Reporter: yunfei liu
> Assignee: yunfei liu
>
> when we use HCatOutputFormat to write to an external partitioned table, a tmp dir (which starts with "_SCRATCH" ) will appear under table path if the job failed.
> {quote}
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:45 /tmp/hive/_SCRATCH0.31946356159329714
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:51 /tmp/hive/_SCRATCH0.31946356159329714/c1=1
> drwxr-xr-x - yun hdfs 0 2017-02-27 00:57 /tmp/hive/c1=1
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:28 /tmp/hive/c1=1/c2=2
> -rw-r--r-- 3 yun hdfs 12 2017-02-27 00:57 /tmp/hive/c1=1/c2=2/part-r-00000
> -rw-r--r-- 3 yun hdfs 12 2017-02-27 01:28 /tmp/hive/c1=1/c2=2/part-r-00000_a_1
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)