[jira] [Commented] (HIVE-6219) TestProtocolBuffersObjectInspectors fails when upgrading protobuf to 2.5.0

["Steven Willis (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13913460#comment-13913460 ] 

Steven Willis commented on HIVE-6219:
-------------------------------------

I just added the following to HIVE-5112, but it seems like this issue is a better place to track the incompatibility between hadoop and hive with respect to protocol buffers:

The hive downloads page says that hive-0.12.0 is compatible with hadoop-2.x.y . However, I have hive-0.12.0 installed with hadoop-2.2.0 and I get the same error that Abin Shahab has. I noticed that if I moved all the protobuf-java-2.5.0.jar files under hadoop's lib dirs to protobuf-java-2.5.0.jar.bak, then I didn't get the error.

It looks like protobuf 2.5.0 is not compatible with generated code from 2.4.1, and if I move all of the newer jars out of the way, then the protobuf-java-2.4.1.jar file is found under hive's lib dir.

I think there needs to be a new release (0.12.1 or 0.13.0) with the upgrade to protobuf-2.5.0 and/or the compatibility note on the downloads page needs to be adjusted.

> TestProtocolBuffersObjectInspectors fails when upgrading protobuf to 2.5.0
> --------------------------------------------------------------------------
>
>                 Key: HIVE-6219
>                 URL: https://issues.apache.org/jira/browse/HIVE-6219
>             Project: Hive
>          Issue Type: Bug
>          Components: Serializers/Deserializers
>    Affects Versions: 0.13.0
>            Reporter: Gordon Wang
>
> As Hadoop 2.2.0 is GA, the protobuf version in Hadoop 2.2.0 is protobuf 2.5.0.
> I notice that there is already a jira HIVE-5112 about protobuf upgrading. But in this jira,{code} serde/if/test/complexpb.proto {code}is not generated with protobuf 2.5.0.
> If we generate it with protobuf 2.5.0, then TestProtocolBuffersObjectInspectors fails.
> The error message is like this
> {code}
> java.lang.RuntimeException: Internal error: Cannot find ObjectInspector  for UNKNOWN
> 	at org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorFactory.getPrimitiveJavaObjectInspector(PrimitiveObjectInspectorFactory.java:332)
> 	at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:146)
> 	at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> 	at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:192)
> 	at org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> 	at org.apache.hadoop.hive.serde2.objectinspector.TestProtocolBuffersObjectInspectors.testProtocolBuffersObjectInspectors(TestProtocolBuffersObjectInspectors.java:40)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:601)
> 	at junit.framework.TestCase.runTest(TestCase.java:168)
> 	at junit.framework.TestCase.runBare(TestCase.java:134)
> 	at junit.framework.TestResult$1.protect(TestResult.java:110)
> 	at junit.framework.TestResult.runProtected(TestResult.java:128)
> 	at junit.framework.TestResult.run(TestResult.java:113)
> 	at junit.framework.TestCase.run(TestCase.java:124)
> 	at junit.framework.TestSuite.runTest(TestSuite.java:243)
> 	at junit.framework.TestSuite.run(TestSuite.java:238)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:520)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1060)
> 	at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:911)
> {code}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)