[jira] [Commented] (HIVE-5112) Upgrade protobuf to 2.5 from 2.4

["Abin Shahab (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890348#comment-13890348 ] 

Abin Shahab commented on HIVE-5112:
-----------------------------------

Hi All,
I notice the following exception when we try to use hive-0.12 orcfile format with hadoop-2.2. This goes away when we use it with hadoop-2.0.5. My hunch is that this is caused by the protobuf-2.4.1 code in hive-0.12.
Should the bug be reopened?
Error: java.lang.RuntimeException: Hive Runtime Error while closing operators
	at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:240)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157)
Caused by: java.lang.UnsupportedOperationException: This is supposed to be overridden by subclasses.
	at com.google.protobuf.GeneratedMessage.getUnknownFields(GeneratedMessage.java:180)
	at org.apache.hadoop.hive.ql.io.orc.OrcProto$Type.getSerializedSize(OrcProto.java:7281)
	at com.google.protobuf.CodedOutputStream.computeMessageSizeNoTag(CodedOutputStream.java:749)
	at com.google.protobuf.CodedOutputStream.computeMessageSize(CodedOutputStream.java:530)
	at org.apache.hadoop.hive.ql.io.orc.OrcProto$Footer.getSerializedSize(OrcProto.java:9054)
	at org.apache.hadoop.hive.ql.io.orc.OrcProto$Footer.writeTo(OrcProto.java:9007)
	at org.apache.hadoop.hive.ql.io.orc.WriterImpl.writeFooter(WriterImpl.java:1804)
	at org.apache.hadoop.hive.ql.io.orc.WriterImpl.close(WriterImpl.java:1869)
	at org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat$OrcRecordWriter.close(OrcOutputFormat.java:95)
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.closeWriters(FileSinkOperator.java:181)
	at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:866)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:596)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:613)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:613)
	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:613)
	at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:207)


> Upgrade protobuf to 2.5 from 2.4
> --------------------------------
>
>                 Key: HIVE-5112
>                 URL: https://issues.apache.org/jira/browse/HIVE-5112
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Brock Noland
>            Assignee: Owen O'Malley
>             Fix For: 0.13.0
>
>         Attachments: HIVE-5112.2.patch, HIVE-5112.D12429.1.patch
>
>
> Hadoop and Hbase have both upgraded protobuf. We should as well.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)