You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2017/02/26 16:23:46 UTC
[jira] [Commented] (HIVE-16041) HCatalog doesn't delete temp
_SCRATCH dir when job failed
[ https://issues.apache.org/jira/browse/HIVE-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15884799#comment-15884799 ]
Hive QA commented on HIVE-16041:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12854774/HIVE-16041.1.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3797/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3797/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3797/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Tests exited with: ExecutionException: java.util.concurrent.ExecutionException: org.apache.hive.ptest.execution.ssh.SSHExecutionException: RSyncResult [localFile=/data/hiveptest/logs/PreCommit-HIVE-Build-3797/succeeded/268_TestTxnCommands2WithSplitUpdate, remoteFile=/home/hiveptest/104.154.183.241-hiveptest-0/logs/, getExitCode()=11, getException()=null, getUser()=hiveptest, getHost()=104.154.183.241, getInstance()=0]: 'Warning: Permanently added '104.154.183.241' (ECDSA) to the list of known hosts.
receiving incremental file list
./
TEST-268_TestTxnCommands2WithSplitUpdate-TEST-org.apache.hadoop.hive.ql.TestTxnCommands2WithSplitUpdate.xml
0 0% 0.00kB/s 0:00:00
10,167 100% 9.70MB/s 0:00:00 (xfr#1, to-chk=5/7)
maven-test.txt
0 0% 0.00kB/s 0:00:00
5,930 100% 5.66MB/s 0:00:00 (xfr#2, to-chk=4/7)
logs/
logs/derby.log
0 0% 0.00kB/s 0:00:00
978 100% 955.08kB/s 0:00:00 (xfr#3, to-chk=1/7)
logs/hive.log
0 0% 0.00kB/s 0:00:00
rsync: write failed on "/data/hiveptest/logs/PreCommit-HIVE-Build-3797/succeeded/268_TestTxnCommands2WithSplitUpdate/logs/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.1]
Warning: Permanently added '104.154.183.241' (ECDSA) to the list of known hosts.
receiving incremental file list
logs/
logs/hive.log
0 0% 0.00kB/s 0:00:00
rsync: write failed on "/data/hiveptest/logs/PreCommit-HIVE-Build-3797/succeeded/268_TestTxnCommands2WithSplitUpdate/logs/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.1]
Warning: Permanently added '104.154.183.241' (ECDSA) to the list of known hosts.
receiving incremental file list
logs/
logs/hive.log
0 0% 0.00kB/s 0:00:00
rsync: write failed on "/data/hiveptest/logs/PreCommit-HIVE-Build-3797/succeeded/268_TestTxnCommands2WithSplitUpdate/logs/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.1]
Warning: Permanently added '104.154.183.241' (ECDSA) to the list of known hosts.
receiving incremental file list
logs/
logs/hive.log
0 0% 0.00kB/s 0:00:00
rsync: write failed on "/data/hiveptest/logs/PreCommit-HIVE-Build-3797/succeeded/268_TestTxnCommands2WithSplitUpdate/logs/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.1]
Warning: Permanently added '104.154.183.241' (ECDSA) to the list of known hosts.
receiving incremental file list
logs/
logs/hive.log
0 0% 0.00kB/s 0:00:00
rsync: write failed on "/data/hiveptest/logs/PreCommit-HIVE-Build-3797/succeeded/268_TestTxnCommands2WithSplitUpdate/logs/hive.log": No space left on device (28)
rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.1]
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12854774 - PreCommit-HIVE-Build
> HCatalog doesn't delete temp _SCRATCH dir when job failed
> ----------------------------------------------------------
>
> Key: HIVE-16041
> URL: https://issues.apache.org/jira/browse/HIVE-16041
> Project: Hive
> Issue Type: Bug
> Components: HCatalog
> Affects Versions: 2.2.0
> Reporter: yunfei liu
> Assignee: yunfei liu
> Fix For: 2.2.0
>
> Attachments: HIVE-16041.1.patch
>
>
> when we use HCatOutputFormat to write to an external partitioned table, a tmp dir (which starts with "_SCRATCH" ) will appear under table path if the job failed.
> {quote}
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:45 /tmp/hive/_SCRATCH0.31946356159329714
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:51 /tmp/hive/_SCRATCH0.31946356159329714/c1=1
> drwxr-xr-x - yun hdfs 0 2017-02-27 00:57 /tmp/hive/c1=1
> drwxr-xr-x - yun hdfs 0 2017-02-27 01:28 /tmp/hive/c1=1/c2=2
> -rw-r--r-- 3 yun hdfs 12 2017-02-27 00:57 /tmp/hive/c1=1/c2=2/part-r-00000
> -rw-r--r-- 3 yun hdfs 12 2017-02-27 01:28 /tmp/hive/c1=1/c2=2/part-r-00000_a_1
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)