You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "BELUGA BEHR (JIRA)" <ji...@apache.org> on 2018/07/13 15:01:00 UTC

[jira] [Created] (HIVE-20170) Improve JoinOperator "rows for join key" Logging

BELUGA BEHR created HIVE-20170:
----------------------------------

             Summary: Improve JoinOperator "rows for join key" Logging
                 Key: HIVE-20170
                 URL: https://issues.apache.org/jira/browse/HIVE-20170
             Project: Hive
          Issue Type: Improvement
          Components: Operators
    Affects Versions: 3.0.0, 4.0.0
            Reporter: BELUGA BEHR


{code}
2018-06-25 09:37:33,193 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 5728000 rows for join key [333, 22]
2018-06-25 09:37:33,901 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 5828000 rows for join key [333, 22]
2018-06-25 09:37:34,623 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 5928000 rows for join key [333, 22]
2018-06-25 09:37:35,342 INFO [main] org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 6028000 rows for join key [333, 22]
{code}

https://github.com/apache/hive/blob/6d890faf22fd1ede3658a5eed097476eab3c67e9/ql/src/java/org/apache/hadoop/hive/ql/exec/JoinOperator.java#L120

This logging should use the same facilities as the other Operators for emitting this type of log message. [HIVE-10078]  Maybe this feature should be refactored into an AbstractOperator class?

Also, it should print a final count for each join value.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)