You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Phabricator (Updated) (JIRA)" <ji...@apache.org> on 2011/12/10 00:28:41 UTC

[jira] [Updated] (HIVE-2642) fix Hive-2566 and make union optimization more aggressive

     [ https://issues.apache.org/jira/browse/HIVE-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Phabricator updated HIVE-2642:
------------------------------

    Attachment: HIVE-2642.D735.1.patch

heyongqiang requested code review of "HIVE-2642 [jira] fix Hive-2566 and make union optimization more aggressive".
Reviewers: JIRA

  fix Hive-2566 and make union optimization more aggressive

  Hive-2566 did some optimizations to union, but cause some problems. And then got reverted. This is to get it back and fix the problems we saw, and also make union optimization more aggressive.

TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D735

AFFECTED FILES
  ql/src/test/results/clientpositive/merge4.q.out
  ql/src/test/results/clientpositive/auto_join27.q.out
  ql/src/test/results/clientpositive/union19.q.out
  ql/src/test/results/clientpositive/union4.q.out
  ql/src/test/results/clientpositive/union14.q.out
  ql/src/test/results/clientpositive/create_view.q.out
  ql/src/test/results/clientpositive/union5.q.out
  ql/src/test/results/clientpositive/ql_rewrite_gbtoidx.q.out
  ql/src/test/results/clientpositive/load_dyn_part14.q.out
  ql/src/test/results/clientpositive/union15.q.out
  ql/src/test/results/clientpositive/union24.q.out
  ql/src/test/results/clientpositive/union10.q.out
  ql/src/test/results/clientpositive/input25.q.out
  ql/src/test/results/clientpositive/union6.q.out
  ql/src/test/results/clientpositive/lineage1.q.out
  ql/src/test/results/clientpositive/union25.q.out
  ql/src/test/results/clientpositive/union11.q.out
  ql/src/test/results/clientpositive/join35.q.out
  ql/src/test/results/clientpositive/union20.q.out
  ql/src/test/results/clientpositive/input26.q.out
  ql/src/test/results/clientpositive/union7.q.out
  ql/src/test/results/clientpositive/union17.q.out
  ql/src/test/results/clientpositive/union26.q.out
  ql/src/test/results/clientpositive/union12.q.out
  ql/src/test/results/clientpositive/stats1.q.out
  ql/src/test/results/clientpositive/union18.q.out
  ql/src/test/results/clientpositive/union3.q.out
  ql/src/test/results/clientpositive/union22.q.out
  ql/src/test/results/clientpositive/ppd_union_view.q.out
  ql/src/test/queries/clientpositive/union25.q
  ql/src/test/queries/clientpositive/merge4.q
  ql/src/test/queries/clientpositive/union26.q
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRProcContext.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRUnion1.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRRedSink3.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRFileSink1.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcContext.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcFactory.java

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/1581/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.

                
> fix Hive-2566 and make union optimization more aggressive 
> ----------------------------------------------------------
>
>                 Key: HIVE-2642
>                 URL: https://issues.apache.org/jira/browse/HIVE-2642
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: He Yongqiang
>            Assignee: He Yongqiang
>         Attachments: HIVE-2642.D735.1.patch
>
>
> Hive-2566 did some optimizations to union, but cause some problems. And then got reverted. This is to get it back and fix the problems we saw, and also make union optimization more aggressive.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira