You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Mohit Sikri (JIRA)" <ji...@apache.org> on 2011/02/08 13:45:57 UTC
[jira] Commented: (HIVE-307) "LOAD DATA LOCAL INPATH" fails when
the table already contains a file of the same name
[ https://issues.apache.org/jira/browse/HIVE-307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12991955#comment-12991955 ]
Mohit Sikri commented on HIVE-307:
----------------------------------
Hello Namit/Kirk/He Yongqiang,
I was evaluating this defect, but it seems it is incomplete(falling short) of its cause.
It should also work fine for queries like
LOAD DATA INPATH './kv2.txt' INTO TABLE tst_src1;
But unfortunately :-( it is failing, giving null pointer exception in copyFiles() method [Hive.java]. I tested it against Hive0.7 snapshot of the latest build.
The difference between the query present in the test case and the one I mentioned is the Path from which kv2.txt is fetched, the source path in former is a hdfs temp directory(say /tmp/hive-root/2097947077/10000 under which kv2.txt is present) whereas in the later it is a hdfs file which is being actually referred.
So the changes i.e. renaming done by checkPaths() method to avoid conflict is not visible outside it's scope ;i.e. not detected by fs.listStatus() where in actual the renamed file(say /user/root/kv2.txt_copy_1) is moved to tst_src1 warehouse (say /user/hive/warehouse/tst_src1).
Kindly confirm, so that I can raise a new bug or re-open the existing one.
> "LOAD DATA LOCAL INPATH" fails when the table already contains a file of the same name
> --------------------------------------------------------------------------------------
>
> Key: HIVE-307
> URL: https://issues.apache.org/jira/browse/HIVE-307
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
> Affects Versions: 0.5.0, 0.6.0
> Reporter: Zheng Shao
> Assignee: Kirk True
> Priority: Critical
> Fix For: 0.7.0
>
> Attachments: HIVE-307.patch, HIVE-307.patch, HIVE-307.v3.patch, hive-307.1.svn.patch
>
>
> Failed with exception checkPaths: /user/zshao/warehouse/tmp_user_msg_history/test_user_msg_history already exists
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira