[jira] [Commented] (TEZ-3416) ArrayIndexOutOfBoundsException happens in ScatterGatherEdgeManager after DAG recovery

["Zhiyuan Yang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431797#comment-15431797 ] 

Zhiyuan Yang commented on TEZ-3416:
-----------------------------------

Please notice the Hive and Tez here is compiled with cartesian product edge. While the problem seems unrelated with cartesian product edge, there might still be a chance. I'll try to reproduce this bug without cartesian product edge.

> ArrayIndexOutOfBoundsException happens in ScatterGatherEdgeManager after DAG recovery
> -------------------------------------------------------------------------------------
>
>                 Key: TEZ-3416
>                 URL: https://issues.apache.org/jira/browse/TEZ-3416
>             Project: Apache Tez
>          Issue Type: Bug
>            Reporter: Zhiyuan Yang
>            Assignee: Zhiyuan Yang
>         Attachments: applog
>
>
> This happened in Hive on Tez. The query is select count(\*) from f as a, f as b. When I manually killed AM, all vertices except the one join the data finished reconfiguration. After recovery, DAG failed with ArrayIndexOutOfBoundsException in ScatterGatherEdgeManager of the counting vertex. It doesn't happen every time.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)