You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Brock Noland (JIRA)" <ji...@apache.org> on 2013/06/13 03:06:20 UTC
[jira] [Commented] (HIVE-3025) Fix Hive ARCHIVE command on 0.22 and
0.23
[ https://issues.apache.org/jira/browse/HIVE-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13681824#comment-13681824 ]
Brock Noland commented on HIVE-3025:
------------------------------------
Due to this archive_multi.q (and others) fail for 0.23. The error for archive_multi.q is below. It looks to because HarFileSystem (potentially through makeQualified) will add en extra : to the authority and this extra colon trips up HiveFileFormatUtils.getPartitionDescFromPathRecursively. See "cannot find dir = har://pfile-localhost:/" below versions the paths in pathToPartitionInfo "har://pfile-localhost/".
{noformat}
[junit] java.io.IOException: cannot find dir = har://pfile-localhost:/home/noland/workspaces/hive-apache/hive/build/ql/test/data/warehouse/tstsrcpart/ds=2008-04-08/data.har/hr=11/000000_0 in pathToPartitionInfo: [har://pfile-localhost/home/noland/workspaces/hive-apache/hive/build/ql/test/data/warehouse/tstsrcpart/ds=2008-04-08/data.har/hr=11, har://pfile-localhost/home/noland/workspaces/hive-apache/hive/build/ql/test/data/warehouse/tstsrcpart/ds=2008-04-08/data.har/hr=12]
[junit] at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getPartitionDescFromPathRecursively(HiveFileFormatUtils.java:298)
[junit] at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getPartitionDescFromPathRecursively(HiveFileFormatUtils.java:260)
[junit] at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat$CombineHiveInputSplit.<init>(CombineHiveInputFormat.java:104)
[junit] at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:409)
[junit] at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:480)
[junit] at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:472)
[junit] at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:367)
[junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1218)
[junit] at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215)
{noformat}
> Fix Hive ARCHIVE command on 0.22 and 0.23
> -----------------------------------------
>
> Key: HIVE-3025
> URL: https://issues.apache.org/jira/browse/HIVE-3025
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
> Affects Versions: 0.9.0
> Reporter: Carl Steinbach
> Assignee: Carl Steinbach
> Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-3025.D3195.1.patch
>
>
> archive.q and archive_multi.q fail when Hive is run on top of Hadoop 0.22 or 0.23.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira