You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by vi...@apache.org on 2014/01/30 21:46:19 UTC
svn commit: r1562955 [9/14] - in /hive/trunk:
common/src/java/org/apache/hadoop/hive/conf/ conf/
itests/util/src/main/java/org/apache/hadoop/hive/ql/hooks/
ql/src/java/org/apache/hadoop/hive/ql/exec/
ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ ql/sr...
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out Thu Jan 30 20:46:16 2014
@@ -70,76 +70,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin_part_1) a) (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin_part_2) b) (and (AND (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)) (= (. (TOK_TABLE_OR_COL a) part) '1')) (= (. (TOK_TABLE_OR_COL b) part) '1')))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST b))) (TOK_SELEXPR (TOK_FUNCTIONSTAR count)))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Partition Description:
- Partition
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- partition values:
- part 1
- properties:
- COLUMN_STATS_ACCURATE true
- bucket_count 3
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- numFiles 3
- numRows 0
- partition_columns part
- rawDataSize 0
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- totalSize 4200
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- properties:
- bucket_count 2
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- partition_columns part
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.srcbucket_mapjoin_part_2
- name: default.srcbucket_mapjoin_part_2
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- Statistics:
- numRows: 1050 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -183,6 +117,59 @@ STAGE PLANS:
type: bigint
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Partition Description:
+ Partition
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ partition values:
+ part 1
+ properties:
+ COLUMN_STATS_ACCURATE true
+ bucket_count 3
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ numFiles 3
+ numRows 0
+ partition_columns part
+ rawDataSize 0
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ totalSize 4200
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ properties:
+ bucket_count 2
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ partition_columns part
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.srcbucket_mapjoin_part_2
+ name: default.srcbucket_mapjoin_part_2
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
+ Statistics:
+ numRows: 1050 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -349,76 +336,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin_part_1) a) (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin_part_2) b) (AND (AND (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)) (= (. (TOK_TABLE_OR_COL a) part) '1')) (= (. (TOK_TABLE_OR_COL b) part) '1')))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST b))) (TOK_SELEXPR (TOK_FUNCTIONSTAR count)))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Partition Description:
- Partition
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- partition values:
- part 1
- properties:
- COLUMN_STATS_ACCURATE true
- bucket_count 2
- bucket_field_name value
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- numFiles 2
- numRows 0
- partition_columns part
- rawDataSize 0
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- totalSize 2750
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- properties:
- bucket_count 2
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- partition_columns part
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.srcbucket_mapjoin_part_2
- name: default.srcbucket_mapjoin_part_2
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- Statistics:
- numRows: 687 dataSize: 2750 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -462,6 +383,59 @@ STAGE PLANS:
type: bigint
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Partition Description:
+ Partition
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ partition values:
+ part 1
+ properties:
+ COLUMN_STATS_ACCURATE true
+ bucket_count 2
+ bucket_field_name value
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ numFiles 2
+ numRows 0
+ partition_columns part
+ rawDataSize 0
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ totalSize 2750
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ properties:
+ bucket_count 2
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ partition_columns part
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.srcbucket_mapjoin_part_2
+ name: default.srcbucket_mapjoin_part_2
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
+ Statistics:
+ numRows: 687 dataSize: 2750 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out Thu Jan 30 20:46:16 2014
@@ -60,8 +60,7 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin) a) (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin_part) b) (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME bucketmapjoin_tmp_result))) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST b))) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) value)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL b) value))) (TOK_WHERE (= (. (TOK_TABLE_OR_COL b) ds) "2008-04-08"))))
STAGE DEPENDENCIES:
- Stage-9 is a root stage
- Stage-1 depends on stages: Stage-9
+ Stage-1 is a root stage
Stage-8 depends on stages: Stage-1 , consists of Stage-5, Stage-4, Stage-6
Stage-5
Stage-0 depends on stages: Stage-5, Stage-4, Stage-7
@@ -71,71 +70,6 @@ STAGE DEPENDENCIES:
Stage-7 depends on stages: Stage-6
STAGE PLANS:
- Stage: Stage-9
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Partition Description:
- Partition
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- partition values:
- ds 2008-04-08
- properties:
- COLUMN_STATS_ACCURATE true
- bucket_count 3
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part
- numFiles 3
- numRows 0
- partition_columns ds
- rawDataSize 0
- serialization.ddl struct srcbucket_mapjoin_part { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- totalSize 4200
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- properties:
- bucket_count 3
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part
- partition_columns ds
- serialization.ddl struct srcbucket_mapjoin_part { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.srcbucket_mapjoin_part
- name: default.srcbucket_mapjoin_part
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- Statistics:
- numRows: 40 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -198,6 +132,59 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Partition Description:
+ Partition
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ partition values:
+ ds 2008-04-08
+ properties:
+ COLUMN_STATS_ACCURATE true
+ bucket_count 3
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part
+ numFiles 3
+ numRows 0
+ partition_columns ds
+ rawDataSize 0
+ serialization.ddl struct srcbucket_mapjoin_part { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ totalSize 4200
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ properties:
+ bucket_count 3
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part
+ partition_columns ds
+ serialization.ddl struct srcbucket_mapjoin_part { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.srcbucket_mapjoin_part
+ name: default.srcbucket_mapjoin_part
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
+ Statistics:
+ numRows: 40 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out Thu Jan 30 20:46:16 2014
@@ -67,8 +67,7 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin) a) (TOK_TABREF (TOK_TABNAME srcbucket_mapjoin_part_2) b) (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME bucketmapjoin_tmp_result))) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST b))) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) value)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL b) value)))))
STAGE DEPENDENCIES:
- Stage-9 is a root stage
- Stage-1 depends on stages: Stage-9
+ Stage-1 is a root stage
Stage-8 depends on stages: Stage-1 , consists of Stage-5, Stage-4, Stage-6
Stage-5
Stage-0 depends on stages: Stage-5, Stage-4, Stage-7
@@ -78,119 +77,6 @@ STAGE DEPENDENCIES:
Stage-7 depends on stages: Stage-6
STAGE PLANS:
- Stage: Stage-9
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Partition Description:
- Partition
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- partition values:
- ds 2008-04-08
- properties:
- COLUMN_STATS_ACCURATE true
- bucket_count 2
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- numFiles 2
- numRows 0
- partition_columns ds
- rawDataSize 0
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- totalSize 3062
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- properties:
- bucket_count 2
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- partition_columns ds
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.srcbucket_mapjoin_part_2
- name: default.srcbucket_mapjoin_part_2
- Partition
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- partition values:
- ds 2008-04-09
- properties:
- COLUMN_STATS_ACCURATE true
- bucket_count 2
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- numFiles 2
- numRows 0
- partition_columns ds
- rawDataSize 0
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- totalSize 3062
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- properties:
- bucket_count 2
- bucket_field_name key
- columns key,value
- columns.types int:string
-#### A masked pattern was here ####
- name default.srcbucket_mapjoin_part_2
- partition_columns ds
- serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
- serialization.format 1
- serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
-#### A masked pattern was here ####
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.srcbucket_mapjoin_part_2
- name: default.srcbucket_mapjoin_part_2
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- Statistics:
- numRows: 58 dataSize: 6124 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 0
- Bucket Mapjoin Context:
- Alias Bucket Base File Name Mapping:
- b {srcbucket20.txt=[ds=2008-04-08/srcbucket22.txt, ds=2008-04-09/srcbucket22.txt], srcbucket21.txt=[ds=2008-04-08/srcbucket23.txt, ds=2008-04-09/srcbucket23.txt]}
- Alias Bucket File Name Mapping:
-#### A masked pattern was here ####
- Alias Bucket Output File Name Mapping:
-#### A masked pattern was here ####
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -254,6 +140,107 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Partition Description:
+ Partition
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ partition values:
+ ds 2008-04-08
+ properties:
+ COLUMN_STATS_ACCURATE true
+ bucket_count 2
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ numFiles 2
+ numRows 0
+ partition_columns ds
+ rawDataSize 0
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ totalSize 3062
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ properties:
+ bucket_count 2
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ partition_columns ds
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.srcbucket_mapjoin_part_2
+ name: default.srcbucket_mapjoin_part_2
+ Partition
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ partition values:
+ ds 2008-04-09
+ properties:
+ COLUMN_STATS_ACCURATE true
+ bucket_count 2
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ numFiles 2
+ numRows 0
+ partition_columns ds
+ rawDataSize 0
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ totalSize 3062
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ properties:
+ bucket_count 2
+ bucket_field_name key
+ columns key,value
+ columns.types int:string
+#### A masked pattern was here ####
+ name default.srcbucket_mapjoin_part_2
+ partition_columns ds
+ serialization.ddl struct srcbucket_mapjoin_part_2 { i32 key, string value}
+ serialization.format 1
+ serialization.lib org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+#### A masked pattern was here ####
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.srcbucket_mapjoin_part_2
+ name: default.srcbucket_mapjoin_part_2
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
+ Statistics:
+ numRows: 58 dataSize: 6124 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
+ Bucket Mapjoin Context:
+ Alias Bucket Base File Name Mapping:
+ b {srcbucket20.txt=[ds=2008-04-08/srcbucket22.txt, ds=2008-04-09/srcbucket22.txt], srcbucket21.txt=[ds=2008-04-08/srcbucket23.txt, ds=2008-04-09/srcbucket23.txt]}
+ Alias Bucket File Name Mapping:
+#### A masked pattern was here ####
+ Alias Bucket Output File Name Mapping:
+#### A masked pattern was here ####
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out Thu Jan 30 20:46:16 2014
@@ -116,41 +116,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test1) L) (TOK_TABREF (TOK_TABNAME test1) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
- Bucket Mapjoin Context:
- Alias Bucket Base File Name Mapping:
- r {srcbucket20.txt=[srcbucket20.txt], srcbucket21.txt=[srcbucket21.txt], srcbucket22.txt=[srcbucket22.txt]}
- Alias Bucket File Name Mapping:
-#### A masked pattern was here ####
- Alias Bucket Output File Name Mapping:
-#### A masked pattern was here ####
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -212,6 +181,24 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
+ Bucket Mapjoin Context:
+ Alias Bucket Base File Name Mapping:
+ r {srcbucket20.txt=[srcbucket20.txt], srcbucket21.txt=[srcbucket21.txt], srcbucket22.txt=[srcbucket22.txt]}
+ Alias Bucket File Name Mapping:
+#### A masked pattern was here ####
+ Alias Bucket Output File Name Mapping:
+#### A masked pattern was here ####
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -276,41 +263,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test2) L) (TOK_TABREF (TOK_TABNAME test2) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
- Bucket Mapjoin Context:
- Alias Bucket Base File Name Mapping:
- r {srcbucket20.txt=[srcbucket20.txt], srcbucket21.txt=[srcbucket21.txt], srcbucket22.txt=[srcbucket22.txt]}
- Alias Bucket File Name Mapping:
-#### A masked pattern was here ####
- Alias Bucket Output File Name Mapping:
-#### A masked pattern was here ####
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -372,6 +328,24 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
+ Bucket Mapjoin Context:
+ Alias Bucket Base File Name Mapping:
+ r {srcbucket20.txt=[srcbucket20.txt], srcbucket21.txt=[srcbucket21.txt], srcbucket22.txt=[srcbucket22.txt]}
+ Alias Bucket File Name Mapping:
+#### A masked pattern was here ####
+ Alias Bucket Output File Name Mapping:
+#### A masked pattern was here ####
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -438,34 +412,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test1) L) (TOK_TABREF (TOK_TABNAME test1) R) (= (+ (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL L) key)) (. (TOK_TABLE_OR_COL R) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [GenericUDFOPPlus(Column[key], Column[key])]
- 1 [GenericUDFBridge(Column[key])]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -526,6 +476,17 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -590,34 +551,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test1) L) (TOK_TABREF (TOK_TABNAME test2) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -678,6 +615,17 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -742,34 +690,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test1) L) (TOK_TABREF (TOK_TABNAME test3) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -830,6 +754,17 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -894,34 +829,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test1) L) (TOK_TABREF (TOK_TABNAME test4) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -982,6 +893,17 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -1046,34 +968,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test2) L) (TOK_TABREF (TOK_TABNAME test3) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -1134,6 +1032,17 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -1198,34 +1107,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test2) L) (TOK_TABREF (TOK_TABNAME test4) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -1286,6 +1171,17 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -1350,34 +1246,10 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test3) L) (TOK_TABREF (TOK_TABNAME test4) R) (AND (= (. (TOK_TABLE_OR_COL L) key) (. (TOK_TABLE_OR_COL R) key)) (= (. (TOK_TABLE_OR_COL L) value) (. (TOK_TABLE_OR_COL R) value))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_HINTLIST (TOK_HINT TOK_MAPJOIN (TOK_HINTARGLIST R))) (TOK_SELEXPR TOK_ALLCOLREF))))
STAGE DEPENDENCIES:
- Stage-3 is a root stage
- Stage-1 depends on stages: Stage-3
+ Stage-1 is a root stage
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-3
- Map Reduce Local Work
- Alias -> Map Local Tables:
- r
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- r
- TableScan
- alias: r
- Statistics:
- numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
- GatherStats: false
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {key} {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[value]]
- 1 [Column[key], Column[value]]
- Position of Big Table: 0
-
Stage: Stage-1
Map Reduce
Alias -> Map Operator Tree:
@@ -1438,6 +1310,17 @@ STAGE PLANS:
MultiFileSpray: false
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ r
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ r
+ TableScan
+ alias: r
+ Statistics:
+ numRows: 21 dataSize: 4200 basicStatsState: COMPLETE colStatsState: NONE
+ GatherStats: false
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_2.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_2.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_2.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_2.q.out Thu Jan 30 20:46:16 2014
@@ -285,39 +285,17 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test_table1) a) (TOK_TABREF (TOK_TABNAME test_table2) b) (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME test_table3) (TOK_PARTSPEC (TOK_PARTVAL ds '1')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (TOK_FUNCTION concat (. (TOK_TABLE_OR_COL a) value) (. (TOK_TABLE_OR_COL b) value)))) (TOK_WHERE (and (TOK_FUNCTION TOK_ISNOTNULL (. (TOK_TABLE_OR_COL a) ds)) (= (. (TOK_TABLE_OR_COL b) ds) '1')))))
STAGE DEPENDENCIES:
- Stage-6 is a root stage , consists of Stage-7, Stage-8, Stage-1
- Stage-7 has a backup stage: Stage-1
- Stage-4 depends on stages: Stage-7
+ Stage-6 is a root stage , consists of Stage-4, Stage-5, Stage-1
+ Stage-4 has a backup stage: Stage-1
Stage-0 depends on stages: Stage-1, Stage-4, Stage-5
Stage-3 depends on stages: Stage-0
- Stage-8 has a backup stage: Stage-1
- Stage-5 depends on stages: Stage-8
+ Stage-5 has a backup stage: Stage-1
Stage-1
STAGE PLANS:
Stage: Stage-6
Conditional Operator
- Stage: Stage-7
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 0
-
Stage: Stage-4
Map Reduce
Alias -> Map Operator Tree:
@@ -359,6 +337,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
Reduce Operator Tree:
Extract
File Output Operator
@@ -385,26 +371,6 @@ STAGE PLANS:
Stage: Stage-3
Stats-Aggr Operator
- Stage: Stage-8
- Map Reduce Local Work
- Alias -> Map Local Tables:
- a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- a
- TableScan
- alias: a
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
-
Stage: Stage-5
Map Reduce
Alias -> Map Operator Tree:
@@ -446,6 +412,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ a
+ TableScan
+ alias: a
Reduce Operator Tree:
Extract
File Output Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_4.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_4.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_4.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_4.q.out Thu Jan 30 20:46:16 2014
@@ -266,39 +266,17 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test_table1) a) (TOK_TABREF (TOK_TABNAME test_table2) b) (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME test_table3) (TOK_PARTSPEC (TOK_PARTVAL ds '1')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) value))) (TOK_WHERE (and (= (. (TOK_TABLE_OR_COL a) ds) '1') (= (. (TOK_TABLE_OR_COL b) ds) '1')))))
STAGE DEPENDENCIES:
- Stage-6 is a root stage , consists of Stage-7, Stage-8, Stage-1
- Stage-7 has a backup stage: Stage-1
- Stage-4 depends on stages: Stage-7
+ Stage-6 is a root stage , consists of Stage-4, Stage-5, Stage-1
+ Stage-4 has a backup stage: Stage-1
Stage-0 depends on stages: Stage-1, Stage-4, Stage-5
Stage-3 depends on stages: Stage-0
- Stage-8 has a backup stage: Stage-1
- Stage-5 depends on stages: Stage-8
+ Stage-5 has a backup stage: Stage-1
Stage-1
STAGE PLANS:
Stage: Stage-6
Conditional Operator
- Stage: Stage-7
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 0
-
Stage: Stage-4
Map Reduce
Alias -> Map Operator Tree:
@@ -340,6 +318,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
Reduce Operator Tree:
Extract
File Output Operator
@@ -366,26 +352,6 @@ STAGE PLANS:
Stage: Stage-3
Stats-Aggr Operator
- Stage: Stage-8
- Map Reduce Local Work
- Alias -> Map Local Tables:
- a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- a
- TableScan
- alias: a
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
-
Stage: Stage-5
Map Reduce
Alias -> Map Operator Tree:
@@ -427,6 +393,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ a
+ TableScan
+ alias: a
Reduce Operator Tree:
Extract
File Output Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_5.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_5.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_5.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_5.q.out Thu Jan 30 20:46:16 2014
@@ -71,39 +71,17 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test_table1) a) (TOK_TABREF (TOK_TABNAME test_table2) b) (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME test_table3) (TOK_PARTSPEC (TOK_PARTVAL ds '1')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (TOK_FUNCTION concat (. (TOK_TABLE_OR_COL a) value) (. (TOK_TABLE_OR_COL b) value)))) (TOK_WHERE (and (= (. (TOK_TABLE_OR_COL a) ds) '1') (= (. (TOK_TABLE_OR_COL b) ds) '1')))))
STAGE DEPENDENCIES:
- Stage-6 is a root stage , consists of Stage-7, Stage-8, Stage-1
- Stage-7 has a backup stage: Stage-1
- Stage-4 depends on stages: Stage-7
+ Stage-6 is a root stage , consists of Stage-4, Stage-5, Stage-1
+ Stage-4 has a backup stage: Stage-1
Stage-0 depends on stages: Stage-1, Stage-4, Stage-5
Stage-3 depends on stages: Stage-0
- Stage-8 has a backup stage: Stage-1
- Stage-5 depends on stages: Stage-8
+ Stage-5 has a backup stage: Stage-1
Stage-1
STAGE PLANS:
Stage: Stage-6
Conditional Operator
- Stage: Stage-7
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 0
-
Stage: Stage-4
Map Reduce
Alias -> Map Operator Tree:
@@ -145,6 +123,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
Reduce Operator Tree:
Extract
File Output Operator
@@ -171,26 +157,6 @@ STAGE PLANS:
Stage: Stage-3
Stats-Aggr Operator
- Stage: Stage-8
- Map Reduce Local Work
- Alias -> Map Local Tables:
- a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- a
- TableScan
- alias: a
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
-
Stage: Stage-5
Map Reduce
Alias -> Map Operator Tree:
@@ -232,6 +198,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ a
+ TableScan
+ alias: a
Reduce Operator Tree:
Extract
File Output Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_6.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_6.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_6.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/bucketsortoptimize_insert_6.q.out Thu Jan 30 20:46:16 2014
@@ -448,39 +448,17 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test_table1) a) (TOK_TABREF (TOK_TABNAME test_table2) b) (and (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)) (= (. (TOK_TABLE_OR_COL a) key2) (. (TOK_TABLE_OR_COL b) key2))))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME test_table3) (TOK_PARTSPEC (TOK_PARTVAL ds '1')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key2)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (TOK_FUNCTION concat (. (TOK_TABLE_OR_COL a) value) (. (TOK_TABLE_OR_COL b) value)))) (TOK_WHERE (and (= (. (TOK_TABLE_OR_COL a) ds) '1') (= (. (TOK_TABLE_OR_COL b) ds) '1')))))
STAGE DEPENDENCIES:
- Stage-6 is a root stage , consists of Stage-7, Stage-8, Stage-1
- Stage-7 has a backup stage: Stage-1
- Stage-4 depends on stages: Stage-7
+ Stage-6 is a root stage , consists of Stage-4, Stage-5, Stage-1
+ Stage-4 has a backup stage: Stage-1
Stage-0 depends on stages: Stage-1, Stage-4, Stage-5
Stage-3 depends on stages: Stage-0
- Stage-8 has a backup stage: Stage-1
- Stage-5 depends on stages: Stage-8
+ Stage-5 has a backup stage: Stage-1
Stage-1
STAGE PLANS:
Stage: Stage-6
Conditional Operator
- Stage: Stage-7
- Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- HashTable Sink Operator
- condition expressions:
- 0 {key} {key2} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[key2]]
- 1 [Column[key], Column[key2]]
- Position of Big Table: 0
-
Stage: Stage-4
Map Reduce
Alias -> Map Operator Tree:
@@ -530,6 +508,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
Reduce Operator Tree:
Extract
File Output Operator
@@ -556,26 +542,6 @@ STAGE PLANS:
Stage: Stage-3
Stats-Aggr Operator
- Stage: Stage-8
- Map Reduce Local Work
- Alias -> Map Local Tables:
- a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- a
- TableScan
- alias: a
- HashTable Sink Operator
- condition expressions:
- 0 {key} {key2} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[key2]]
- 1 [Column[key], Column[key2]]
- Position of Big Table: 1
-
Stage: Stage-5
Map Reduce
Alias -> Map Operator Tree:
@@ -625,6 +591,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ a
+ TableScan
+ alias: a
Reduce Operator Tree:
Extract
File Output Operator
@@ -732,39 +706,17 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test_table1) a) (TOK_TABREF (TOK_TABNAME test_table2) b) (and (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)) (= (. (TOK_TABLE_OR_COL a) key2) (. (TOK_TABLE_OR_COL b) key2))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key2)) (TOK_SELEXPR (TOK_FUNCTION concat (. (TOK_TABLE_OR_COL a) value) (. (TOK_TABLE_OR_COL b) value)) value)) (TOK_WHERE (and (= (. (TOK_TABLE_OR_COL a) ds) '1') (= (. (TOK_TABLE_OR_COL b) ds) '1'))))) subq1)) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME test_table3) (TOK_PARTSPEC (TOK_PARTVAL ds '1')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq1) key2)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq1) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq1) value)))))
STAGE DEPENDENCIES:
- Stage-6 is a root stage , consists of Stage-7, Stage-8, Stage-1
- Stage-7 has a backup stage: Stage-1
- Stage-4 depends on stages: Stage-7
+ Stage-6 is a root stage , consists of Stage-4, Stage-5, Stage-1
+ Stage-4 has a backup stage: Stage-1
Stage-0 depends on stages: Stage-1, Stage-4, Stage-5
Stage-2 depends on stages: Stage-0
- Stage-8 has a backup stage: Stage-1
- Stage-5 depends on stages: Stage-8
+ Stage-5 has a backup stage: Stage-1
Stage-1
STAGE PLANS:
Stage: Stage-6
Conditional Operator
- Stage: Stage-7
- Map Reduce Local Work
- Alias -> Map Local Tables:
- subq1:b
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- subq1:b
- TableScan
- alias: b
- HashTable Sink Operator
- condition expressions:
- 0 {key} {key2} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[key2]]
- 1 [Column[key], Column[key2]]
- Position of Big Table: 0
-
Stage: Stage-4
Map Reduce
Alias -> Map Operator Tree:
@@ -814,6 +766,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ subq1:b
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ subq1:b
+ TableScan
+ alias: b
Reduce Operator Tree:
Extract
File Output Operator
@@ -840,26 +800,6 @@ STAGE PLANS:
Stage: Stage-2
Stats-Aggr Operator
- Stage: Stage-8
- Map Reduce Local Work
- Alias -> Map Local Tables:
- subq1:a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- subq1:a
- TableScan
- alias: a
- HashTable Sink Operator
- condition expressions:
- 0 {key} {key2} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[key2]]
- 1 [Column[key], Column[key2]]
- Position of Big Table: 1
-
Stage: Stage-5
Map Reduce
Alias -> Map Operator Tree:
@@ -909,6 +849,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ subq1:a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ subq1:a
+ TableScan
+ alias: a
Reduce Operator Tree:
Extract
File Output Operator
@@ -1503,39 +1451,17 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME test_table1) a) (TOK_TABREF (TOK_TABNAME test_table2) b) (and (= (. (TOK_TABLE_OR_COL a) key) (. (TOK_TABLE_OR_COL b) key)) (= (. (TOK_TABLE_OR_COL a) key2) (. (TOK_TABLE_OR_COL b) key2))))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL a) key2)) (TOK_SELEXPR (TOK_FUNCTION concat (. (TOK_TABLE_OR_COL a) value) (. (TOK_TABLE_OR_COL b) value)) value)) (TOK_WHERE (and (= (. (TOK_TABLE_OR_COL a) ds) '1') (= (. (TOK_TABLE_OR_COL b) ds) '1'))))) subq1)) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq1) key2) k1) (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq1) key) k2) (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq1) value))))) subq2)) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME test_table4) (TOK_PARTSPEC (TOK_PARTVAL ds '
1')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq2) k2)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq2) k1)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL subq2) value)))))
STAGE DEPENDENCIES:
- Stage-6 is a root stage , consists of Stage-7, Stage-8, Stage-1
- Stage-7 has a backup stage: Stage-1
- Stage-4 depends on stages: Stage-7
+ Stage-6 is a root stage , consists of Stage-4, Stage-5, Stage-1
+ Stage-4 has a backup stage: Stage-1
Stage-0 depends on stages: Stage-1, Stage-4, Stage-5
Stage-3 depends on stages: Stage-0
- Stage-8 has a backup stage: Stage-1
- Stage-5 depends on stages: Stage-8
+ Stage-5 has a backup stage: Stage-1
Stage-1
STAGE PLANS:
Stage: Stage-6
Conditional Operator
- Stage: Stage-7
- Map Reduce Local Work
- Alias -> Map Local Tables:
- subq2:subq1:b
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- subq2:subq1:b
- TableScan
- alias: b
- HashTable Sink Operator
- condition expressions:
- 0 {key} {key2} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[key2]]
- 1 [Column[key], Column[key2]]
- Position of Big Table: 0
-
Stage: Stage-4
Map Reduce
Alias -> Map Operator Tree:
@@ -1585,6 +1511,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ subq2:subq1:b
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ subq2:subq1:b
+ TableScan
+ alias: b
Reduce Operator Tree:
Extract
File Output Operator
@@ -1611,26 +1545,6 @@ STAGE PLANS:
Stage: Stage-3
Stats-Aggr Operator
- Stage: Stage-8
- Map Reduce Local Work
- Alias -> Map Local Tables:
- subq2:subq1:a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- subq2:subq1:a
- TableScan
- alias: a
- HashTable Sink Operator
- condition expressions:
- 0 {key} {key2} {value}
- 1 {value}
- handleSkewJoin: false
- keys:
- 0 [Column[key], Column[key2]]
- 1 [Column[key], Column[key2]]
- Position of Big Table: 1
-
Stage: Stage-5
Map Reduce
Alias -> Map Operator Tree:
@@ -1680,6 +1594,14 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ subq2:subq1:a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ subq2:subq1:a
+ TableScan
+ alias: a
Reduce Operator Tree:
Extract
File Output Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer1.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer1.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer1.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer1.q.out Thu Jan 30 20:46:16 2014
@@ -376,32 +376,11 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME src1) x) (TOK_TABREF (TOK_TABNAME src) y) (= (. (TOK_TABLE_OR_COL x) key) (. (TOK_TABLE_OR_COL y) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL x) key) key) (TOK_SELEXPR (TOK_FUNCTION count 1) cnt)) (TOK_GROUPBY (. (TOK_TABLE_OR_COL x) key)))) tmp)) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) key)))) (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) cnt)))))))
STAGE DEPENDENCIES:
- Stage-6 is a root stage
- Stage-2 depends on stages: Stage-6
+ Stage-2 is a root stage
Stage-3 depends on stages: Stage-2
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-6
- Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp:x
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp:x
- TableScan
- alias: x
- HashTable Sink Operator
- condition expressions:
- 0 {key}
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
-
Stage: Stage-2
Map Reduce
Alias -> Map Operator Tree:
@@ -448,6 +427,14 @@ STAGE PLANS:
type: bigint
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp:x
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp:x
+ TableScan
+ alias: x
Reduce Operator Tree:
Group By Operator
aggregations:
Modified: hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer3.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer3.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer3.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer3.q.out Thu Jan 30 20:46:16 2014
@@ -608,47 +608,11 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME src1) x) (TOK_TABREF (TOK_TABNAME src) y) (= (. (TOK_TABLE_OR_COL x) key) (. (TOK_TABLE_OR_COL y) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL x) key)) (TOK_SELEXPR (TOK_FUNCTION count 1) cnt)) (TOK_GROUPBY (. (TOK_TABLE_OR_COL x) key)))) b) (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME src1) x) (TOK_TABREF (TOK_TABNAME src) y) (= (. (TOK_TABLE_OR_COL x) key) (. (TOK_TABLE_OR_COL y) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL x) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL x) value))))) d) (= (. (TOK_TABLE_OR_COL b) key) (. (TOK_TABLE_OR_COL d) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL b) key) key) (TOK_SELEXPR (. (TOK_TABLE_OR_COL b) cnt) cn
t) (TOK_SELEXPR (. (TOK_TABLE_OR_COL d) value) value)))) tmp)) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) key)))) (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) cnt)))) (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) value)))))))
STAGE DEPENDENCIES:
- Stage-9 is a root stage
- Stage-2 depends on stages: Stage-9
+ Stage-2 is a root stage
Stage-3 depends on stages: Stage-2
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-9
- Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp:b:x
- Fetch Operator
- limit: -1
- tmp:d:x
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp:b:x
- TableScan
- alias: x
- HashTable Sink Operator
- condition expressions:
- 0 {key}
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
- tmp:d:x
- TableScan
- alias: x
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
-
Stage: Stage-2
Map Reduce
Alias -> Map Operator Tree:
@@ -729,6 +693,20 @@ STAGE PLANS:
type: string
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp:b:x
+ Fetch Operator
+ limit: -1
+ tmp:d:x
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp:b:x
+ TableScan
+ alias: x
+ tmp:d:x
+ TableScan
+ alias: x
Reduce Operator Tree:
Demux Operator
Group By Operator
@@ -1474,47 +1452,11 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME src1) x) (TOK_TABREF (TOK_TABNAME src) y) (= (. (TOK_TABLE_OR_COL x) key) (. (TOK_TABLE_OR_COL y) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL x) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL x) value))))) b) (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME src1) x) (TOK_TABREF (TOK_TABNAME src) y) (= (. (TOK_TABLE_OR_COL x) key) (. (TOK_TABLE_OR_COL y) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL x) key)) (TOK_SELEXPR (TOK_FUNCTION count 1) cnt)) (TOK_GROUPBY (. (TOK_TABLE_OR_COL x) key)))) d) (= (. (TOK_TABLE_OR_COL b) key) (. (TOK_TABLE_OR_COL d) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL d) key) key) (TOK_SELEXPR (. (TOK_TABLE_OR_COL d) cnt) cn
t) (TOK_SELEXPR (. (TOK_TABLE_OR_COL b) value) value)))) tmp)) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) key)))) (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) cnt)))) (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) value)))))))
STAGE DEPENDENCIES:
- Stage-9 is a root stage
- Stage-2 depends on stages: Stage-9
+ Stage-2 is a root stage
Stage-3 depends on stages: Stage-2
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-9
- Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp:b:x
- Fetch Operator
- limit: -1
- tmp:d:x
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp:b:x
- TableScan
- alias: x
- HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
- tmp:d:x
- TableScan
- alias: x
- HashTable Sink Operator
- condition expressions:
- 0 {key}
- 1
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
-
Stage: Stage-2
Map Reduce
Alias -> Map Operator Tree:
@@ -1595,6 +1537,20 @@ STAGE PLANS:
type: bigint
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp:b:x
+ Fetch Operator
+ limit: -1
+ tmp:d:x
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp:b:x
+ TableScan
+ alias: x
+ tmp:d:x
+ TableScan
+ alias: x
Reduce Operator Tree:
Demux Operator
Mux Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer4.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer4.q.out?rev=1562955&r1=1562954&r2=1562955&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer4.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/correlationoptimizer4.q.out Thu Jan 30 20:46:16 2014
@@ -433,51 +433,11 @@ ABSTRACT SYNTAX TREE:
(TOK_QUERY (TOK_FROM (TOK_SUBQUERY (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_JOIN (TOK_TABREF (TOK_TABNAME T2) x) (TOK_TABREF (TOK_TABNAME T1) y) (= (. (TOK_TABLE_OR_COL x) key) (. (TOK_TABLE_OR_COL y) key))) (TOK_TABREF (TOK_TABNAME T3) z) (= (. (TOK_TABLE_OR_COL y) key) (. (TOK_TABLE_OR_COL z) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL y) key) key) (TOK_SELEXPR (TOK_FUNCTION count 1) cnt)) (TOK_GROUPBY (. (TOK_TABLE_OR_COL y) key)))) tmp)) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) key)))) (TOK_SELEXPR (TOK_FUNCTION SUM (TOK_FUNCTION HASH (. (TOK_TABLE_OR_COL tmp) cnt)))))))
STAGE DEPENDENCIES:
- Stage-7 is a root stage
- Stage-2 depends on stages: Stage-7
+ Stage-2 is a root stage
Stage-3 depends on stages: Stage-2
Stage-0 is a root stage
STAGE PLANS:
- Stage: Stage-7
- Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp:y
- Fetch Operator
- limit: -1
- tmp:z
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp:y
- TableScan
- alias: y
- HashTable Sink Operator
- condition expressions:
- 0
- 1 {key}
- 2
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- 2 [Column[key]]
- Position of Big Table: 0
- tmp:z
- TableScan
- alias: z
- HashTable Sink Operator
- condition expressions:
- 0
- 1 {key}
- 2
- handleSkewJoin: false
- keys:
- 0 [Column[key]]
- 1 [Column[key]]
- 2 [Column[key]]
- Position of Big Table: 0
-
Stage: Stage-2
Map Reduce
Alias -> Map Operator Tree:
@@ -527,6 +487,20 @@ STAGE PLANS:
type: bigint
Local Work:
Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp:y
+ Fetch Operator
+ limit: -1
+ tmp:z
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp:y
+ TableScan
+ alias: y
+ tmp:z
+ TableScan
+ alias: z
Reduce Operator Tree:
Group By Operator
aggregations: