[jira] [Comment Edited] (TEZ-4404) Hive on tez report IndexOutofBoundary Exception when query hive external table

["László Bodor (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17564571#comment-17564571 ] 

László Bodor edited comment on TEZ-4404 at 7/9/22 11:20 AM:
------------------------------------------------------------

thanks for reporting this [~airbots]!
could you please provide further details about the issue?
1. what's tez version? (need to find where this exception is thrown from exactly)
2. if you have the chance to debug, can you tell what resources are in the list?

 these informations are needed to decide whether this is a tez or a hive issue (e.g. invalid usage of tez session resources)


was (Author: abstractdog):
thanks for reporting this [~airbots]!
could you please provide further details about the issue?
1. what's tez version? (need to find where this exception is thrown from exactly)
2. if you have the chance to debug, can you tell what resources are in the list?

 

> Hive on tez report IndexOutofBoundary Exception when query hive external table
> ------------------------------------------------------------------------------
>
>                 Key: TEZ-4404
>                 URL: https://issues.apache.org/jira/browse/TEZ-4404
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.9.2
>            Reporter: Chen He
>            Priority: Major
>
> We creat a Hive external table mapping to Hbase, when I query it using select, it reports following errors. Once I switch to "hive.execution.engine=mr", the problem gone. I am using GCP Dataproc single cluster. 
> 2022-04-14 02:44:26,587 ERROR [c50cc557-0b28-4d31-80e9-8eae45cd1499 main] exec.Task: Failed to execute tez graph.
> java.lang.IndexOutOfBoundsException: Index: 12, Size: 12
>     at java.util.ArrayList.rangeCheck(ArrayList.java:659)
>     at java.util.ArrayList.get(ArrayList.java:435)
>     at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.ensureLocalResources(TezSessionState.java:634)
>     at org.apache.hadoop.hive.ql.exec.tez.TezTask.ensureSessionHasResources(TezTask.java:371)
>     at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:195)
>     at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:205)
>     at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:97)
>     at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2664)
>     at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:2335)
>     at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:2011)
>     at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1709)
>     at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1703)
>     at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:157)
>     at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:218)
>     at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:239)
>     at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188)
>     at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402)
>     at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821)
>     at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
>     at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:498)
>     at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:236)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)