You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Sonal Goyal <so...@gmail.com> on 2013/11/07 17:50:27 UTC
Re: Exceptions while running Hive
Does your hive classpath contain the jar having
com.dyuproject.protostuff.Schema
?
Best Regards,
Sonal
Nube Technologies <http://www.nubetech.co>
<http://in.linkedin.com/in/sonalgoyal>
On Thu, Nov 7, 2013 at 9:16 PM, Narla,Venkatesh
<Ve...@cerner.com>wrote:
> Hello,
>
>
> I am getting the following exception when I try to run a query. Can any
> body help me what the problem might be in this scenario.
>
> Thanks for you time.
>
>
> 2013-11-07 09:23:38,498 FATAL ExecMapper: java.lang.NoClassDefFoundError: com/dyuproject/protostuff/Schema
> at com.cerner.kepler.directory.Directory.initialize(Directory.java:240)
> at com.cerner.kepler.directory.Directory.getInstance(Directory.java:227)
> at com.cerner.kepler.entity.hbase.EntityTypeStore.remoteLoadTypeMap(EntityTypeStore.java:256)
> at com.cerner.kepler.entity.hbase.EntityTypeStore.loadTypeMap(EntityTypeStore.java:152)
> at com.cerner.kepler.entity.hbase.EntityTypeStore.getTypeFromId(EntityTypeStore.java:637)
> at com.cerner.kepler.entity.hbase.EntityTypeStore.toEntityKey(EntityTypeStore.java:584)
> at com.cerner.kepler.entity.hbase.HBaseKeyEncoder.toKey(HBaseKeyEncoder.java:48)
> at com.cerner.kepler.hive.KeplerCompositeKey.init(KeplerCompositeKey.java:99)
> at org.apache.hadoop.hive.hbase.RawExtensionLazyRow.uncheckedGetField(RawExtensionLazyRow.java:232)
> at org.apache.hadoop.hive.hbase.RawExtensionLazyRow.getField(RawExtensionLazyRow.java:163)
> at org.apache.hadoop.hive.serde2.lazy.objectinspector.LazySimpleStructObjectInspector.getStructFieldData(LazySimpleStructObjectInspector.java:229)
> at org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.evaluate(ExprNodeColumnEvaluator.java:98)
> at org.apache.hadoop.hive.ql.exec.ExprNodeFieldEvaluator.evaluate(ExprNodeFieldEvaluator.java:80)
> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64)
> at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPEqual.evaluate(GenericUDFOPEqual.java:38)
> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64)
> at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd.evaluate(GenericUDFOPAnd.java:52)
> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
> at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:118)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:83)
> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
> at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:546)
> at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:393)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
> at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
> at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: java.lang.ClassNotFoundException: com.dyuproject.protostuff.Schema
> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
> ... 35 more
>
> CONFIDENTIALITY NOTICE This message and any included attachments are
> from Cerner Corporation and are intended only for the addressee. The
> information contained in this message is confidential and may constitute
> inside or non-public information under international, federal, or state
> securities laws. Unauthorized forwarding, printing, copying, distribution,
> or use of such information is strictly prohibited and may be unlawful. If
> you are not the addressee, please promptly delete this message and notify
> the sender of the delivery error by e-mail or you may call Cerner's
> corporate offices in Kansas City, Missouri, U.S.A at (+1) (816)221-1024.
>
Re: Exceptions while running Hive
Posted by Sonal Goyal <so...@gmail.com>.
Just looking at the stacktrace - I think the protostuff jars are being
referenced by your custom hive serde, so I doubt it could have worked
earlier.
Best Regards,
Sonal
Nube Technologies <http://www.nubetech.co>
<http://in.linkedin.com/in/sonalgoyal>
On Sat, Nov 9, 2013 at 1:39 AM, Narla,Venkatesh
<Ve...@cerner.com>wrote:
> Thanks Sonal
>
> I Checked the class path of hive and I do not find the jar. But is this
> a compulsory jar that needs to be in hive class path. I did not face the
> problem earlier even without this jar.Could you help me with some
> information on it. Thank you for your time.
>
>
> Regards
> VN
> From: Sonal Goyal <so...@gmail.com>
> Reply-To: "user@hive.apache.org" <us...@hive.apache.org>
> Date: Thursday, November 7, 2013 10:50 AM
> To: "user@hive.apache.org" <us...@hive.apache.org>
> Subject: Re: Exceptions while running Hive
>
> Does your hive classpath contain the jar having
> com.dyuproject.protostuff.Schema ?
>
> Best Regards,
> Sonal
> Nube Technologies<https://urldefense.proofpoint.com/v1/url?u=http://www.nubetech.co&k=PmKqfXspAHNo6iYJ48Q45A%3D%3D%0A&r=aqNUF8tRpvxC7s%2FASnqJIMx2lZ43gnNyUPac3kIkf6c%3D%0A&m=eBrey%2BlmsztwYexIY2eG%2FBeqKKMqTBat0wA2VkQCB9A%3D%0A&s=d392eafb03f5c57529e8d3c1a945516e4a071e551c5f785c8ffb835fbdb5bca5>
>
>
> <https://urldefense.proofpoint.com/v1/url?u=http://in.linkedin.com/in/sonalgoyal&k=PmKqfXspAHNo6iYJ48Q45A%3D%3D%0A&r=aqNUF8tRpvxC7s%2FASnqJIMx2lZ43gnNyUPac3kIkf6c%3D%0A&m=eBrey%2BlmsztwYexIY2eG%2FBeqKKMqTBat0wA2VkQCB9A%3D%0A&s=63fcbbf17fa4cca8dcc808692d4dc97866ab523b00c566ceddabde9d8484e2ab>
>
>
>
>
> On Thu, Nov 7, 2013 at 9:16 PM, Narla,Venkatesh <
> Venkatesh.Narla@cerner.com> wrote:
>
>> Hello,
>>
>>
>> I am getting the following exception when I try to run a query. Can any
>> body help me what the problem might be in this scenario.
>>
>> Thanks for you time.
>>
>>
>> 2013-11-07 09:23:38,498 FATAL ExecMapper: java.lang.NoClassDefFoundError: com/dyuproject/protostuff/Schema
>> at com.cerner.kepler.directory.Directory.initialize(Directory.java:240)
>> at com.cerner.kepler.directory.Directory.getInstance(Directory.java:227)
>> at com.cerner.kepler.entity.hbase.EntityTypeStore.remoteLoadTypeMap(EntityTypeStore.java:256)
>> at com.cerner.kepler.entity.hbase.EntityTypeStore.loadTypeMap(EntityTypeStore.java:152)
>> at com.cerner.kepler.entity.hbase.EntityTypeStore.getTypeFromId(EntityTypeStore.java:637)
>> at com.cerner.kepler.entity.hbase.EntityTypeStore.toEntityKey(EntityTypeStore.java:584)
>> at com.cerner.kepler.entity.hbase.HBaseKeyEncoder.toKey(HBaseKeyEncoder.java:48)
>> at com.cerner.kepler.hive.KeplerCompositeKey.init(KeplerCompositeKey.java:99)
>> at org.apache.hadoop.hive.hbase.RawExtensionLazyRow.uncheckedGetField(RawExtensionLazyRow.java:232)
>> at org.apache.hadoop.hive.hbase.RawExtensionLazyRow.getField(RawExtensionLazyRow.java:163)
>> at org.apache.hadoop.hive.serde2.lazy.objectinspector.LazySimpleStructObjectInspector.getStructFieldData(LazySimpleStructObjectInspector.java:229)
>> at org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.evaluate(ExprNodeColumnEvaluator.java:98)
>> at org.apache.hadoop.hive.ql.exec.ExprNodeFieldEvaluator.evaluate(ExprNodeFieldEvaluator.java:80)
>> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64)
>> at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPEqual.evaluate(GenericUDFOPEqual.java:38)
>> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
>> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64)
>> at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd.evaluate(GenericUDFOPAnd.java:52)
>> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
>> at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:118)
>> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
>> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
>> at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:83)
>> at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
>> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
>> at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:546)
>> at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
>> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
>> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:393)
>> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
>> at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at javax.security.auth.Subject.doAs(Subject.java:396)
>> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
>> at org.apache.hadoop.mapred.Child.main(Child.java:262)
>> Caused by: java.lang.ClassNotFoundException: com.dyuproject.protostuff.Schema
>> at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
>> at java.security.AccessController.doPrivileged(Native Method)
>> at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>> ... 35 more
>>
>> CONFIDENTIALITY NOTICE This message and any included attachments are
>> from Cerner Corporation and are intended only for the addressee. The
>> information contained in this message is confidential and may constitute
>> inside or non-public information under international, federal, or state
>> securities laws. Unauthorized forwarding, printing, copying, distribution,
>> or use of such information is strictly prohibited and may be unlawful. If
>> you are not the addressee, please promptly delete this message and notify
>> the sender of the delivery error by e-mail or you may call Cerner's
>> corporate offices in Kansas City, Missouri, U.S.A at (+1) (816)221-1024.
>>
>
>
Re: Exceptions while running Hive
Posted by "Narla,Venkatesh" <Ve...@Cerner.com>.
Thanks Sonal
I Checked the class path of hive and I do not find the jar. But is this a compulsory jar that needs to be in hive class path. I did not face the problem earlier even without this jar.Could you help me with some information on it. Thank you for your time.
Regards
VN
From: Sonal Goyal <so...@gmail.com>>
Reply-To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Date: Thursday, November 7, 2013 10:50 AM
To: "user@hive.apache.org<ma...@hive.apache.org>" <us...@hive.apache.org>>
Subject: Re: Exceptions while running Hive
Does your hive classpath contain the jar having com.dyuproject.protostuff.Schema ?
Best Regards,
Sonal
Nube Technologies<https://urldefense.proofpoint.com/v1/url?u=http://www.nubetech.co&k=PmKqfXspAHNo6iYJ48Q45A%3D%3D%0A&r=aqNUF8tRpvxC7s%2FASnqJIMx2lZ43gnNyUPac3kIkf6c%3D%0A&m=eBrey%2BlmsztwYexIY2eG%2FBeqKKMqTBat0wA2VkQCB9A%3D%0A&s=d392eafb03f5c57529e8d3c1a945516e4a071e551c5f785c8ffb835fbdb5bca5>
<https://urldefense.proofpoint.com/v1/url?u=http://in.linkedin.com/in/sonalgoyal&k=PmKqfXspAHNo6iYJ48Q45A%3D%3D%0A&r=aqNUF8tRpvxC7s%2FASnqJIMx2lZ43gnNyUPac3kIkf6c%3D%0A&m=eBrey%2BlmsztwYexIY2eG%2FBeqKKMqTBat0wA2VkQCB9A%3D%0A&s=63fcbbf17fa4cca8dcc808692d4dc97866ab523b00c566ceddabde9d8484e2ab>
On Thu, Nov 7, 2013 at 9:16 PM, Narla,Venkatesh <Ve...@cerner.com>> wrote:
Hello,
I am getting the following exception when I try to run a query. Can any body help me what the problem might be in this scenario.
Thanks for you time.
2013-11-07 09:23:38,498 FATAL ExecMapper: java.lang.NoClassDefFoundError: com/dyuproject/protostuff/Schema
at com.cerner.kepler.directory.Directory.initialize(Directory.java:240)
at com.cerner.kepler.directory.Directory.getInstance(Directory.java:227)
at com.cerner.kepler.entity.hbase.EntityTypeStore.remoteLoadTypeMap(EntityTypeStore.java:256)
at com.cerner.kepler.entity.hbase.EntityTypeStore.loadTypeMap(EntityTypeStore.java:152)
at com.cerner.kepler.entity.hbase.EntityTypeStore.getTypeFromId(EntityTypeStore.java:637)
at com.cerner.kepler.entity.hbase.EntityTypeStore.toEntityKey(EntityTypeStore.java:584)
at com.cerner.kepler.entity.hbase.HBaseKeyEncoder.toKey(HBaseKeyEncoder.java:48)
at com.cerner.kepler.hive.KeplerCompositeKey.init(KeplerCompositeKey.java:99)
at org.apache.hadoop.hive.hbase.RawExtensionLazyRow.uncheckedGetField(RawExtensionLazyRow.java:232)
at org.apache.hadoop.hive.hbase.RawExtensionLazyRow.getField(RawExtensionLazyRow.java:163)
at org.apache.hadoop.hive.serde2.lazy.objectinspector.LazySimpleStructObjectInspector.getStructFieldData(LazySimpleStructObjectInspector.java:229)
at org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.evaluate(ExprNodeColumnEvaluator.java:98)
at org.apache.hadoop.hive.ql.exec.ExprNodeFieldEvaluator.evaluate(ExprNodeFieldEvaluator.java:80)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPEqual.evaluate(GenericUDFOPEqual.java:38)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPAnd.evaluate(GenericUDFOPAnd.java:52)
at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:118)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:83)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:474)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:800)
at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:546)
at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:393)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.lang.ClassNotFoundException: com.dyuproject.protostuff.Schema
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 35 more
CONFIDENTIALITY NOTICE This message and any included attachments are from Cerner Corporation and are intended only for the addressee. The information contained in this message is confidential and may constitute inside or non-public information under international, federal, or state securities laws. Unauthorized forwarding, printing, copying, distribution, or use of such information is strictly prohibited and may be unlawful. If you are not the addressee, please promptly delete this message and notify the sender of the delivery error by e-mail or you may call Cerner's corporate offices in Kansas City, Missouri, U.S.A at (+1) (816)221-1024.