You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Joseph Hammerman (JIRA)" <ji...@apache.org> on 2012/08/03 22:07:02 UTC

[jira] [Created] (HIVE-3332) Reduce jobs fail using an RCFile with SnappyCodec

Joseph Hammerman created HIVE-3332:
--------------------------------------

             Summary: Reduce jobs fail using an RCFile with SnappyCodec
                 Key: HIVE-3332
                 URL: https://issues.apache.org/jira/browse/HIVE-3332
             Project: Hive
          Issue Type: Bug
          Components: Compression
    Affects Versions: 0.8.1
         Environment: CentOS 6.1(Santiago)
hive-0.8.1+61-1.cdh4.0.1.p0.1.el6.noarch
hadoop-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-hdfs-secondarynamenode-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-yarn-proxyserver-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-yarn-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-hdfs-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-0.20-mapreduce-0.20.2+1216-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-client-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-mapreduce-historyserver-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-yarn-resourcemanager-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
hadoop-mapreduce-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
            Reporter: Joseph Hammerman


Hello Hive developers,

Here is a pastebin with the DDL we were attempting to perform the reduce job against:

http://pastebin.com/iFXjEEYq

Interestingly, the user is able to load data into the table using Snappy, it is only when the table is queried that the error is encountered.

Please let me know if you have any follow up questions, or if there is any testing I can perform on my end to move the project along.

Joseph Hammerman

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3332) Reduce jobs fail using an RCFile with SnappyCodec

Posted by "Joseph Hammerman (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13428334#comment-13428334 ] 

Joseph Hammerman commented on HIVE-3332:
----------------------------------------

Should have mentioned that no error is encountered using SnappyCodec and SequenceFiles, or RCFiles with no compression.
                
> Reduce jobs fail using an RCFile with SnappyCodec
> -------------------------------------------------
>
>                 Key: HIVE-3332
>                 URL: https://issues.apache.org/jira/browse/HIVE-3332
>             Project: Hive
>          Issue Type: Bug
>          Components: Compression
>    Affects Versions: 0.8.1
>         Environment: CentOS 6.1(Santiago)
> hive-0.8.1+61-1.cdh4.0.1.p0.1.el6.noarch
> hadoop-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-hdfs-secondarynamenode-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-yarn-proxyserver-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-yarn-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-hdfs-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-0.20-mapreduce-0.20.2+1216-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-client-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-mapreduce-historyserver-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-yarn-resourcemanager-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
> hadoop-mapreduce-2.0.0+91-1.cdh4.0.1.p0.1.el6.x86_64
>            Reporter: Joseph Hammerman
>
> Hello Hive developers,
> Here is a pastebin with the DDL we were attempting to perform the reduce job against:
> http://pastebin.com/iFXjEEYq
> Interestingly, the user is able to load data into the table using Snappy, it is only when the table is queried that the error is encountered.
> Please let me know if you have any follow up questions, or if there is any testing I can perform on my end to move the project along.
> Joseph Hammerman

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira