You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2016/07/15 06:42:20 UTC

[jira] [Created] (HIVE-14246) Tez: disable auto-reducer parallelism when CUSTOM_EDGE is in place

Gopal V created HIVE-14246:
------------------------------

             Summary: Tez: disable auto-reducer parallelism when CUSTOM_EDGE is in place
                 Key: HIVE-14246
                 URL: https://issues.apache.org/jira/browse/HIVE-14246
             Project: Hive
          Issue Type: Bug
          Components: Tez
    Affects Versions: 2.2.0
            Reporter: Gopal V
            Assignee: Gopal V
             Fix For: 2.2.0


The CUSTOM_SIMPLE_EDGE impl has differences between the size constraints of either edge which cannot be represented by the ShuffleVertexManager presently.

Reducing the width based on the hashtable build side vs the streaming probe side have different consequences since there is no order of runtime between them.

Until the two parent vertices of the shuffle hash-join are related, this feature causes massive inconsistency of performance across runs.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)