You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Gopal V (JIRA)" <ji...@apache.org> on 2018/10/17 19:48:00 UTC

[jira] [Created] (HIVE-20764) Tez: ReduceRecordProcessor::init() can avoid doing .waitForAllInputsReady()

Gopal V created HIVE-20764:
------------------------------

             Summary: Tez: ReduceRecordProcessor::init() can avoid doing .waitForAllInputsReady()
                 Key: HIVE-20764
                 URL: https://issues.apache.org/jira/browse/HIVE-20764
             Project: Hive
          Issue Type: Bug
            Reporter: Gopal V


The ReduceRecordProcessor waits for all inputs to be ready before starting to initialize the input operators.

This is not necessary for the unsorted shuffle cases, as just having one input (the hash side) entirely ready is sufficient to start doing useful work with the operators (i.e build the hashtable).

{code}
    if (shuffleInputs != null) {
      l4j.info("Waiting for ShuffleInputs to become ready");
      processorContext.waitForAllInputsReady(new ArrayList<Input>(shuffleInputs));
    }
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)