[jira] [Commented] (HIVE-13280) Error when more than 1 mapper for HBase storage handler

["Vsevolod Ostapenko (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-13280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15312867#comment-15312867 ] 

Vsevolod Ostapenko commented on HIVE-13280:
-------------------------------------------

We are observing a similar behavior in HDP 2.4.0 when using TEZ execution engine.
Insert into HBased-backed tables that do not require multiple mappers succeed.
Ones that require multiple mappers fail with exactly the same errors.

If hive execution engine is set to MR, statements succeed and data are inserted as expected.


> Error when more than 1 mapper for HBase storage handler
> -------------------------------------------------------
>
>                 Key: HIVE-13280
>                 URL: https://issues.apache.org/jira/browse/HIVE-13280
>             Project: Hive
>          Issue Type: Bug
>          Components: HBase Handler
>    Affects Versions: 2.0.0
>            Reporter: Damien Carol
>
> With a simple query (select from orc table and insert into HBase external table):
> {code:sql}
> insert into table register.register  select * from aa_temp
> {code}
> The aa_temp table have 45 orc files. It generate 45 mappers.
> Some mappers fail with this error:
> {noformat}
> Caused by: java.lang.IllegalArgumentException: Must specify table name
>         at org.apache.hadoop.hbase.mapreduce.TableOutputFormat.setConf(TableOutputFormat.java:188)
>         at org.apache.hive.common.util.ReflectionUtil.setConf(ReflectionUtil.java:101)
>         at org.apache.hive.common.util.ReflectionUtil.newInstance(ReflectionUtil.java:87)
>         at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:300)
>         at org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.getHiveOutputFormat(HiveFileFormatUtils.java:290)
>         at org.apache.hadoop.hive.ql.exec.FileSinkOperator.createHiveOutputFormat(FileSinkOperator.java:1126)
>         ... 25 more
> ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:35, Vertex vertex_1457964631631_0015_3_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 (state=08S01,code=2)
> {noformat}
> If I do an ALTER CONCATENATE for aa_temp. And redo the query. Everything is fine because there are only one mapper.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)