You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Shuang Wu (JIRA)" <ji...@apache.org> on 2013/03/11 18:01:14 UTC
[jira] [Commented] (HIVE-1633) CombineHiveInputFormat fails with
"cannot find dir for emptyFile"
[ https://issues.apache.org/jira/browse/HIVE-1633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13598983#comment-13598983 ]
Shuang Wu commented on HIVE-1633:
---------------------------------
This bug seems to also show up in hive local mode, the empty temporary file path is not qualified with "file:/".
2013-03-11 09:34:30,767 INFO io.CombineHiveInputFormat (CombineHiveInputFormat.java:getSplits(363)) - CombineHiveInputSplit creating pool for file:/var/folders/w7/fp4gml2n1xqg2434qdp799r00002cr/T/shuang/hive_2013-03-11_09-34-29_301_2567414763209147193/-mr-10000/1; using filter path file:/var/folders/w7/fp4gml2n1xqg2434qdp799r00002cr/T/shuang/hive_2013-03-11_09-34-29_301_2567414763209147193/-mr-10000/1
2013-03-11 09:34:30,772 INFO mapred.FileInputFormat (FileInputFormat.java:listStatus(196)) - Total input paths to process : 1
2013-03-11 09:34:30,778 INFO mapred.JobClient (JobClient.java:run(919)) - Cleaning up the staging area file:/data/hadoop/cache/analytics-mr.sv2/shuang/mapred/staging/shuang-1827099888/.staging/job_local_0001
2013-03-11 09:34:30,778 ERROR security.UserGroupInformation (UserGroupInformation.java:doAs(1180)) - PriviledgedActionException as:shuang (auth:SIMPLE) cause:java.io.FileNotFoundException: File does not exist: /var/folders/w7/fp4gml2n1xqg2434qdp799r00002cr/T/shuang/hive_2013-03-11_09-34-29_301_2567414763209147193/-mr-10000/1/emptyFile
2013-03-11 09:34:30,779 ERROR exec.ExecDriver (SessionState.java:printError(365)) - Job Submission failed with exception 'java.io.FileNotFoundException(File does not exist: /var/folders/w7/fp4gml2n1xqg2434qdp799r00002cr/T/shuang/hive_2013-03-11_09-34-29_301_2567414763209147193/-mr-10000/1/emptyFile)'
java.io.FileNotFoundException: File does not exist: /var/folders/w7/fp4gml2n1xqg2434qdp799r00002cr/T/shuang/hive_2013-03-11_09-34-29_301_2567414763209147193/-mr-10000/1/emptyFile
at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:562)
at org.apache.hadoop.mapred.lib.CombineFileInputFormat$OneFileInfo.<init>(CombineFileInputFormat.java:462)
at org.apache.hadoop.mapred.lib.CombineFileInputFormat.getMoreSplits(CombineFileInputFormat.java:256)
at org.apache.hadoop.mapred.lib.CombineFileInputFormat.getSplits(CombineFileInputFormat.java:212)
at org.apache.hadoop.hive.shims.Hadoop20SShims$CombineFileInputFormatShim.getSplits(Hadoop20SShims.java:347)
at org.apache.hadoop.hive.shims.Hadoop20SShims$CombineFileInputFormatShim.getSplits(Hadoop20SShims.java:313)
at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:377)
at org.apache.hadoop.mapred.JobClient.writeOldSplits(JobClient.java:977)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:969)
at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807)
at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:671)
at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:1092)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
> CombineHiveInputFormat fails with "cannot find dir for emptyFile"
> -----------------------------------------------------------------
>
> Key: HIVE-1633
> URL: https://issues.apache.org/jira/browse/HIVE-1633
> Project: Hive
> Issue Type: Bug
> Components: Clients
> Reporter: Amareshwari Sriramadasu
> Assignee: Sreekanth Ramakrishnan
> Fix For: 0.7.0
>
> Attachments: HIVE-1633.patch
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira