You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by "Kotadiya,Kalpesh" <Ka...@Cerner.com> on 2013/01/21 16:25:36 UTC

Errors for Hive Hbase org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation

Hi,

We have a setup of HIVE on Sanbox environment the queries works fine on that and there are no errors, We have the same setup on Production we are getting the following error from Hbase.

This  errors are showing over and over again. Any idea why this error might be occurring. Since on one environment it works fine and in other it show this error.

Error::

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row [Error getting row data with exception java.lang.NullPointerException
        at com.cerner.kepler.hive.KeplerCompositeKey.getField(KeplerCompositeKey.java:107)
        at org.apache.hadoop.hive.serde2.lazy.objectinspector.LazySimpleStructObjectInspector.getStructFieldData(LazySimpleStructObjectInspector.java:218)
        at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349)
        at org.apache.hadoop.hive.serde2.SerDeUtils.buildJSONString(SerDeUtils.java:349)
        at org.apache.hadoop.hive.serde2.SerDeUtils.getJSONString(SerDeUtils.java:219)
        at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:540)
        at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:393)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
        at org.apache.hadoop.mapred.Child.main(Child.java:262)
 ]
        at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:548)
        at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:143)
        ... 8 more
Caused by: java.lang.RuntimeException: java.io.IOException: org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@17a697a1 closed
        at com.cerner.kepler.util.hbase.InstrumentedHTableFactory.createHTableInterface(InstrumentedHTableFactory.java:197)
        at com.cerner.kepler.util.hbase.HTablePool.createHTable(HTablePool.java:269)
        at com.cerner.kepler.util.hbase.HTablePool.findOrCreateTable(HTablePool.java:200)
        at com.cerner.kepler.util.hbase.HTablePool.getTable(HTablePool.java:175)
        at com.cerner.kepler.util.hbase.HTablePool.getTable(HTablePool.java:218)
        at com.cerner.kepler.entity.hbase.HBaseConnectionManager.getMetaTable(HBaseConnectionManager.java:81)
        at com.cerner.kepler.entity.hbase.EntityTypeStore.getTypeFromId(EntityTypeStore.java:562)
        at com.cerner.kepler.entity.hbase.EntityTypeStore.toEntityKey(EntityTypeStore.java:511)
        at com.cerner.kepler.entity.hbase.HBaseKeyEncoder.toKey(HBaseKeyEncoder.java:45)
        at com.cerner.kepler.hive.KeplerCompositeKey.init(KeplerCompositeKey.java:92)
        at org.apache.hadoop.hive.hbase.LazyHBaseRow.uncheckedGetField(LazyHBaseRow.java:190)
        at org.apache.hadoop.hive.hbase.LazyHBaseRow.getField(LazyHBaseRow.java:134)
        at org.apache.hadoop.hive.serde2.lazy.objectinspector.LazySimpleStructObjectInspector.getStructFieldData(LazySimpleStructObjectInspector.java:218)
        at org.apache.hadoop.hive.ql.exec.ExprNodeColumnEvaluator.evaluate(ExprNodeColumnEvaluator.java:98)
        at org.apache.hadoop.hive.ql.exec.ExprNodeFieldEvaluator.evaluate(ExprNodeFieldEvaluator.java:80)
        at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator$DeferredExprObject.get(ExprNodeGenericFuncEvaluator.java:64)
        at org.apache.hadoop.hive.ql.udf.generic.GenericUDFOPGreaterThan.evaluate(GenericUDFOPGreaterThan.java:40)
        at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
        at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:118)
        at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
        at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:83)
        at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:762)
        at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:529)
        ... 9 more
Caused by: java.io.IOException: org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@17a697a1 closed
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:794)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:782)
        at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:251)
        at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:215)
        at com.cerner.kepler.util.hbase.InstrumentedHTableFactory.createHTableInterface(InstrumentedHTableFactory.java:195)
        ... 33 more


  Thanks,


  Kalpesh Kotadiya
  Software Engineer, Cerner Cloud Ops
  kalpesh.kotadiya@cerner.com|<mailto:kalpesh.kotadiya@cerner.com|> 816-888-2522





CONFIDENTIALITY NOTICE This message and any included attachments are from Cerner Corporation and are intended only for the addressee. The information contained in this message is confidential and may constitute inside or non-public information under international, federal, or state securities laws. Unauthorized forwarding, printing, copying, distribution, or use of such information is strictly prohibited and may be unlawful. If you are not the addressee, please promptly delete this message and notify the sender of the delivery error by e-mail or you may call Cerner's corporate offices in Kansas City, Missouri, U.S.A at (+1) (816)221-1024.