You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Phabricator (JIRA)" <ji...@apache.org> on 2012/12/17 12:34:13 UTC
[jira] [Commented] (HIVE-3300) LOAD DATA INPATH fails if a hdfs
file with same name is added to table
[ https://issues.apache.org/jira/browse/HIVE-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13533867#comment-13533867 ]
Phabricator commented on HIVE-3300:
-----------------------------------
njain has commented on the revision "HIVE-3300 [jira] LOAD DATA INPATH fails if a hdfs file with same name is added to table".
INLINE COMMENTS
ql/src/test/queries/clientpositive/load_fs2.q:1 Add some comments in the test.
What are you trying to test ?
REVISION DETAIL
https://reviews.facebook.net/D4383
To: JIRA, navis
Cc: njain
> LOAD DATA INPATH fails if a hdfs file with same name is added to table
> ----------------------------------------------------------------------
>
> Key: HIVE-3300
> URL: https://issues.apache.org/jira/browse/HIVE-3300
> Project: Hive
> Issue Type: Bug
> Components: Import/Export
> Affects Versions: 0.10.0
> Environment: ubuntu linux, hadoop 1.0.3, hive 0.9
> Reporter: Bejoy KS
> Assignee: Navis
> Attachments: HIVE-3300.1.patch.txt, HIVE-3300.D4383.3.patch
>
>
> If we are loading data from local fs to hive tables using 'LOAD DATA LOCAL INPATH' and if a file with the same name exists in the table's location then the new file will be suffixed by *_copy_1.
> But if we do the 'LOAD DATA INPATH' for a file in hdfs then there is no rename happening but just a move task is getting triggered. Since a file with same name exists in same hdfs location, hadoop fs move operation throws an error.
> hive> LOAD DATA INPATH '/userdata/bejoy/site.txt' INTO TABLE test.site;
> Loading data to table test.site
> Failed with exception null
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask
> hive>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira