You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@tez.apache.org by LLBian <li...@126.com> on 2016/01/22 07:08:15 UTC

TEZ log missing

Hello,all:
     
      【My environment versions are :Hadoop 2.6.0 、hive 1.2.1、tez 0.7.0】
     
      Now I executed a HQL “select count(*) from h_im;”(h_im is an external table, hbase table) in hive CLI, it throw exceptions:
    (I am sorry, I can not copy the error information here, because we use inner network,so some information will be omitted)

      INFO [Dispatcher thread: Central] history.HistoryEventHandler: .... .....
                  at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor.run(TezProcessor.java:172)
                  at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:137)
                  at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:337)
                  ......  .......
      Caused by: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing writable org.apache.hadoop.hive.hbase....
                   at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:92)
                   at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:68)
                   at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:367)
                   at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor.run(TezProcessor.java:149)
                   .... 14 more
      Caused by : java.lang.NullPointerException
                   at com.fiberhome.nebula.datacenter.hbasehandler.NBHBaseSerde.deserialize(NBHBaseSerde.java:210)
                   at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.readRow(MapOperator.java:145)
                   at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.access$2(MapOperator.java:143)
                   at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:512)
                   ..... 18 more

         
    I  found this "org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor.run(TezProcessor.java:149)", In my hive source code:
----------------------------------------------------------------------------------------------
line 147: MRTaskReporter mrReporter = new MRTaskReporter(getContext));
line 148: rpoc.init(mrReporter, input, outputs);
line 149: rpoc.run();
--------------------------------------------------------------------------------------------------
      I added a LOG message before line 149:
 "LOG.info("-----TezProcessor.run(), rpoc is " + rpoc.getClass());"
 it wasn't printed in container log. why?(hive.compute.splits.in.am=true) I can not understand,should I change yarn log configurations?

   Any reply will be appreciated.

Thankyou & Best Regards.

---LLBian