You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Vsevolod Ostapenko (JIRA)" <ji...@apache.org> on 2016/11/11 20:36:59 UTC

[jira] [Comment Edited] (HIVE-15103) Error when inserting into hive table with HBase storage handler

    [ https://issues.apache.org/jira/browse/HIVE-15103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15657800#comment-15657800 ] 

Vsevolod Ostapenko edited comment on HIVE-15103 at 11/11/16 8:36 PM:
---------------------------------------------------------------------

The same issue can be observed on Hive 1.2 with Tez in HDP 2.5. Property hbase.mapred.output.outputtable is set to the name of the destination HBase table.

Hive with MR execution engine works as expected.


was (Author: seva_ostapenko):
The same issue can be observed on Hive 1.2 in HDP 2.5. Property hbase.mapred.output.outputtable is set to the name of the destination HBase table.

> Error when inserting into hive table with HBase storage handler
> ---------------------------------------------------------------
>
>                 Key: HIVE-15103
>                 URL: https://issues.apache.org/jira/browse/HIVE-15103
>             Project: Hive
>          Issue Type: Bug
>         Environment: HDP 2.4.2 on centos 6.8 x64
>            Reporter: Edward Chen
>
> Exceptions are returned when executing the following simple insert statement in hive on tez.
> {code}
> insert into table accounts  select * from temp_account;
> {code}
> where table accounts is a hive external table, stored in hbase:
> {code}
> create external table accounts (key:string, value:string)
> stored by 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
> with serdeproperties ("hbase.columns.mapping" = ":key,0:val")
> tblproperties ("hbase.table.name" = "accounts_hbase", "hbase.mapred.output.outputtable" = "accounts_hbase");
> {code}
> The SQL could be executed when hive.execution.engine=mr, however, when set hive.execution.engine=tez, we got following error:
> {code}
> Status: Failed
> Vertex failed, vertexName=Map 1, vertexId=vertex_1475059990829_1927_1_00, diagnostics=[Task failed, taskId=task_1475059990829_1927_1_00_000099, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed
>         at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
>         at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
>         at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:344)
>         at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
>         at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:172)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709)
>         at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:172)
>         at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:168)
>         at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: Map operator initialization failed
>         at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:265)
>         at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:149)
>         ... 14 more
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException: Must specify table name
>         at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createHiveOutputFormat(FileSinkOperator.java:1139)
>         at org.apache.hadoop.hive.ql.exec.FileSinkOperator.initializeOp(FileSinkOperator.java:346)
>         at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:363)
>         at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
>         at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
>         at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
>         at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
>         at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
>         at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
>         at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:482)
>         at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:439)
>         at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
>         at org.apache.hadoop.hive.ql.exec.MapOperator.initializeMapOperator(MapOperator.java:486)
>         at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.init(MapRecordProcessor.java:234)
>         ... 15 more
> Caused by: java.lang.IllegalArgumentException: Must specify table name
>         at org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:195)
>         at org.apache.hive.common.util.ReflectionUtil.setConf(ReflectionUtil.java:101)
>         at org.apache.hive.common.util.ReflectionUtil.newInstance(ReflectionUtil.java:87)
>         at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:277)
>         at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:267)
>         at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createHiveOutputFormat(FileSinkOperator.java:1137)
>         ... 28 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)