You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by ha...@apache.org on 2014/04/03 23:40:23 UTC
svn commit: r1584410 [5/6] - in /hive/trunk:
common/src/java/org/apache/hadoop/hive/conf/ conf/
ql/src/test/results/clientnegative/ ql/src/test/results/clientpositive/
Modified: hive/trunk/ql/src/test/results/clientpositive/multiMapJoin1.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/multiMapJoin1.q.out?rev=1584410&r1=1584409&r2=1584410&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/multiMapJoin1.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/multiMapJoin1.q.out Thu Apr 3 21:40:21 2014
@@ -226,10 +226,44 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-2 is a root stage
+ Stage-7 is a root stage
+ Stage-2 depends on stages: Stage-7
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-7
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ firstjoin:smalltbl1
+ Fetch Operator
+ limit: -1
+ smalltbl2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ firstjoin:smalltbl1
+ TableScan
+ alias: smalltbl1
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {value}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+ smalltbl2
+ TableScan
+ alias: smalltbl2
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0
+ 1
+ keys:
+ 0 _col1 (type: string)
+ 1 value (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -274,22 +308,6 @@ STAGE PLANS:
value expressions: _col0 (type: bigint)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- firstjoin:smalltbl1
- Fetch Operator
- limit: -1
- smalltbl2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- firstjoin:smalltbl1
- TableScan
- alias: smalltbl1
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- smalltbl2
- TableScan
- alias: smalltbl2
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
aggregations: count(VALUE._col0)
@@ -346,6 +364,7 @@ POSTHOOK: Lineage: smalltbl3.key SIMPLE
POSTHOOK: Lineage: smalltbl3.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
+RUN: Stage-7:MAPREDLOCAL
RUN: Stage-2:MAPRED
580
PREHOOK: query: -- Now run a query with two-way join, which should be converted into a
@@ -381,10 +400,44 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-2 is a root stage
+ Stage-7 is a root stage
+ Stage-2 depends on stages: Stage-7
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-7
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ firstjoin:smalltbl1
+ Fetch Operator
+ limit: -1
+ smalltbl2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ firstjoin:smalltbl1
+ TableScan
+ alias: smalltbl1
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {value}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+ smalltbl2
+ TableScan
+ alias: smalltbl2
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0
+ 1
+ keys:
+ 0 _col1 (type: string)
+ 1 value (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -429,22 +482,6 @@ STAGE PLANS:
value expressions: _col0 (type: bigint)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- firstjoin:smalltbl1
- Fetch Operator
- limit: -1
- smalltbl2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- firstjoin:smalltbl1
- TableScan
- alias: smalltbl1
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- smalltbl2
- TableScan
- alias: smalltbl2
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
aggregations: count(VALUE._col0)
@@ -501,6 +538,7 @@ POSTHOOK: Lineage: smalltbl3.key SIMPLE
POSTHOOK: Lineage: smalltbl3.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
+RUN: Stage-7:MAPREDLOCAL
RUN: Stage-2:MAPRED
580
PREHOOK: query: -- Now run a query with two-way join, which should first be converted into a
@@ -540,10 +578,44 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-2 is a root stage
+ Stage-7 is a root stage
+ Stage-2 depends on stages: Stage-7
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-7
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ firstjoin:smalltbl1
+ Fetch Operator
+ limit: -1
+ smalltbl2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ firstjoin:smalltbl1
+ TableScan
+ alias: smalltbl1
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {value}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+ smalltbl2
+ TableScan
+ alias: smalltbl2
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0
+ 1 {key}
+ keys:
+ 0 _col1 (type: string)
+ 1 value (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -594,22 +666,6 @@ STAGE PLANS:
value expressions: _col1 (type: bigint)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- firstjoin:smalltbl1
- Fetch Operator
- limit: -1
- smalltbl2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- firstjoin:smalltbl1
- TableScan
- alias: smalltbl1
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- smalltbl2
- TableScan
- alias: smalltbl2
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
aggregations: count(VALUE._col0)
@@ -669,6 +725,7 @@ POSTHOOK: Lineage: smalltbl3.key SIMPLE
POSTHOOK: Lineage: smalltbl3.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
+RUN: Stage-7:MAPREDLOCAL
RUN: Stage-2:MAPRED
270
10
@@ -865,22 +922,30 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-20 is a root stage , consists of Stage-18, Stage-19, Stage-5
- Stage-18 has a backup stage: Stage-5
- Stage-17 depends on stages: Stage-5, Stage-18, Stage-19 , consists of Stage-15, Stage-16, Stage-1
- Stage-15 has a backup stage: Stage-1
- Stage-14 depends on stages: Stage-1, Stage-15, Stage-16 , consists of Stage-12, Stage-13, Stage-2
- Stage-12 has a backup stage: Stage-2
- Stage-11 depends on stages: Stage-2, Stage-12, Stage-13 , consists of Stage-9, Stage-10, Stage-3
- Stage-9 has a backup stage: Stage-3
+ Stage-20 is a root stage , consists of Stage-27, Stage-28, Stage-5
+ Stage-27 has a backup stage: Stage-5
+ Stage-18 depends on stages: Stage-27
+ Stage-17 depends on stages: Stage-5, Stage-18, Stage-19 , consists of Stage-25, Stage-26, Stage-1
+ Stage-25 has a backup stage: Stage-1
+ Stage-15 depends on stages: Stage-25
+ Stage-14 depends on stages: Stage-1, Stage-15, Stage-16 , consists of Stage-23, Stage-24, Stage-2
+ Stage-23 has a backup stage: Stage-2
+ Stage-12 depends on stages: Stage-23
+ Stage-11 depends on stages: Stage-2, Stage-12, Stage-13 , consists of Stage-21, Stage-22, Stage-3
+ Stage-21 has a backup stage: Stage-3
+ Stage-9 depends on stages: Stage-21
Stage-4 depends on stages: Stage-3, Stage-9, Stage-10
- Stage-10 has a backup stage: Stage-3
+ Stage-22 has a backup stage: Stage-3
+ Stage-10 depends on stages: Stage-22
Stage-3
- Stage-13 has a backup stage: Stage-2
+ Stage-24 has a backup stage: Stage-2
+ Stage-13 depends on stages: Stage-24
Stage-2
- Stage-16 has a backup stage: Stage-1
+ Stage-26 has a backup stage: Stage-1
+ Stage-16 depends on stages: Stage-26
Stage-1
- Stage-19 has a backup stage: Stage-5
+ Stage-28 has a backup stage: Stage-5
+ Stage-19 depends on stages: Stage-28
Stage-5
Stage-0 is a root stage
@@ -888,6 +953,24 @@ STAGE PLANS:
Stage: Stage-20
Conditional Operator
+ Stage: Stage-27
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:join1:smalltbl1
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:join1:smalltbl1
+ TableScan
+ alias: smalltbl1
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key1} {key2} {value}
+ 1 {key}
+ keys:
+ 0 key1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-18
Map Reduce
Map Operator Tree:
@@ -914,18 +997,28 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:join1:smalltbl1
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:join1:smalltbl1
- TableScan
- alias: smalltbl1
Stage: Stage-17
Conditional Operator
+ Stage: Stage-25
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:smalltbl2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:smalltbl2
+ TableScan
+ alias: smalltbl2
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4}
+ 1 {key}
+ keys:
+ 0 _col3 (type: string)
+ 1 value (type: string)
+
Stage: Stage-15
Map Reduce
Map Operator Tree:
@@ -951,18 +1044,28 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:smalltbl2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:smalltbl2
- TableScan
- alias: smalltbl2
Stage: Stage-14
Conditional Operator
+ Stage: Stage-23
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:smalltbl3
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:smalltbl3
+ TableScan
+ alias: smalltbl3
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5}
+ 1 {key}
+ keys:
+ 0 _col1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-12
Map Reduce
Map Operator Tree:
@@ -988,18 +1091,28 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:smalltbl3
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:smalltbl3
- TableScan
- alias: smalltbl3
Stage: Stage-11
Conditional Operator
+ Stage: Stage-21
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ smalltbl4
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ smalltbl4
+ TableScan
+ alias: smalltbl4
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5} {_col6}
+ 1 {key}
+ keys:
+ 0 _col2 (type: string)
+ 1 key (type: string)
+
Stage: Stage-9
Map Reduce
Map Operator Tree:
@@ -1029,14 +1142,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- smalltbl4
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- smalltbl4
- TableScan
- alias: smalltbl4
Stage: Stage-4
Map Reduce
@@ -1064,6 +1169,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ Stage: Stage-22
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ $INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ $INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5} {_col6}
+ 1 {key}
+ keys:
+ 0 _col2 (type: string)
+ 1 key (type: string)
+
Stage: Stage-10
Map Reduce
Map Operator Tree:
@@ -1094,13 +1216,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- $INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- $INTNAME
- TableScan
Stage: Stage-3
Map Reduce
@@ -1146,6 +1261,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-24
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:$INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:$INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5}
+ 1 {key}
+ keys:
+ 0 _col1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-13
Map Reduce
Map Operator Tree:
@@ -1172,13 +1304,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:$INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:$INTNAME
- TableScan
Stage: Stage-2
Map Reduce
@@ -1219,6 +1344,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-26
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:$INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:$INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4}
+ 1 {key}
+ keys:
+ 0 _col3 (type: string)
+ 1 value (type: string)
+
Stage: Stage-16
Map Reduce
Map Operator Tree:
@@ -1245,13 +1387,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:$INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:$INTNAME
- TableScan
Stage: Stage-1
Map Reduce
@@ -1292,6 +1427,24 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-28
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:join1:bigtbl
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:join1:bigtbl
+ TableScan
+ alias: bigtbl
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key1} {key2} {value}
+ 1 {key}
+ keys:
+ 0 key1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-19
Map Reduce
Map Operator Tree:
@@ -1318,14 +1471,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:join1:bigtbl
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:join1:bigtbl
- TableScan
- alias: bigtbl
Stage: Stage-5
Map Reduce
@@ -1462,12 +1607,16 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
RUN: Stage-20:CONDITIONAL
+RUN: Stage-27:MAPREDLOCAL
RUN: Stage-18:MAPRED
RUN: Stage-17:CONDITIONAL
+RUN: Stage-25:MAPREDLOCAL
RUN: Stage-15:MAPRED
RUN: Stage-14:CONDITIONAL
+RUN: Stage-23:MAPREDLOCAL
RUN: Stage-12:MAPRED
RUN: Stage-11:CONDITIONAL
+RUN: Stage-21:MAPREDLOCAL
RUN: Stage-9:MAPRED
RUN: Stage-4:MAPRED
247580 247580 247580 247580 247580 247580 548662743780 548662743780
@@ -1557,10 +1706,72 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-4 is a root stage
+ Stage-13 is a root stage
+ Stage-4 depends on stages: Stage-13
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-13
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:join1:smalltbl1
+ Fetch Operator
+ limit: -1
+ join3:join2:smalltbl2
+ Fetch Operator
+ limit: -1
+ join3:smalltbl3
+ Fetch Operator
+ limit: -1
+ smalltbl4
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:join1:smalltbl1
+ TableScan
+ alias: smalltbl1
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key1} {key2} {value}
+ 1 {key}
+ keys:
+ 0 key1 (type: string)
+ 1 key (type: string)
+ join3:join2:smalltbl2
+ TableScan
+ alias: smalltbl2
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4}
+ 1 {key}
+ keys:
+ 0 _col3 (type: string)
+ 1 value (type: string)
+ join3:smalltbl3
+ TableScan
+ alias: smalltbl3
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5}
+ 1 {key}
+ keys:
+ 0 _col1 (type: string)
+ 1 key (type: string)
+ smalltbl4
+ TableScan
+ alias: smalltbl4
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5} {_col6}
+ 1 {key}
+ keys:
+ 0 _col2 (type: string)
+ 1 key (type: string)
+
Stage: Stage-4
Map Reduce
Map Operator Tree:
@@ -1638,36 +1849,6 @@ STAGE PLANS:
value expressions: _col0 (type: bigint), _col1 (type: bigint), _col2 (type: bigint), _col3 (type: bigint), _col4 (type: bigint), _col5 (type: bigint), _col6 (type: bigint), _col7 (type: bigint)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:join1:smalltbl1
- Fetch Operator
- limit: -1
- join3:join2:smalltbl2
- Fetch Operator
- limit: -1
- join3:smalltbl3
- Fetch Operator
- limit: -1
- smalltbl4
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:join1:smalltbl1
- TableScan
- alias: smalltbl1
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- join3:join2:smalltbl2
- TableScan
- alias: smalltbl2
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- join3:smalltbl3
- TableScan
- alias: smalltbl3
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- smalltbl4
- TableScan
- alias: smalltbl4
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
aggregations: sum(VALUE._col0), sum(VALUE._col1), sum(VALUE._col2), sum(VALUE._col3), sum(VALUE._col4), sum(VALUE._col5), sum(VALUE._col6), sum(VALUE._col7)
@@ -1779,6 +1960,7 @@ POSTHOOK: Lineage: smalltbl3.key SIMPLE
POSTHOOK: Lineage: smalltbl3.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
+RUN: Stage-13:MAPREDLOCAL
RUN: Stage-4:MAPRED
247580 247580 247580 247580 247580 247580 548662743780 548662743780
PREHOOK: query: -- Enable noconditionaltask and set the size of hive.auto.convert.join.noconditionaltask.size
@@ -1869,11 +2051,46 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-11 is a root stage
- Stage-4 depends on stages: Stage-11
+ Stage-14 is a root stage
+ Stage-11 depends on stages: Stage-14
+ Stage-13 depends on stages: Stage-11
+ Stage-4 depends on stages: Stage-13
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-14
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:join1:smalltbl1
+ Fetch Operator
+ limit: -1
+ join3:join2:smalltbl2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:join1:smalltbl1
+ TableScan
+ alias: smalltbl1
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key1} {key2} {value}
+ 1 {key}
+ keys:
+ 0 key1 (type: string)
+ 1 key (type: string)
+ join3:join2:smalltbl2
+ TableScan
+ alias: smalltbl2
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4}
+ 1 {key}
+ keys:
+ 0 _col3 (type: string)
+ 1 value (type: string)
+
Stage: Stage-11
Map Reduce
Map Operator Tree:
@@ -1918,22 +2135,39 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:join1:smalltbl1
- Fetch Operator
- limit: -1
- join3:join2:smalltbl2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:join1:smalltbl1
- TableScan
- alias: smalltbl1
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- join3:join2:smalltbl2
- TableScan
- alias: smalltbl2
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+
+ Stage: Stage-13
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:smalltbl3
+ Fetch Operator
+ limit: -1
+ smalltbl4
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:smalltbl3
+ TableScan
+ alias: smalltbl3
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5}
+ 1 {key}
+ keys:
+ 0 _col1 (type: string)
+ 1 key (type: string)
+ smalltbl4
+ TableScan
+ alias: smalltbl4
+ Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5} {_col6}
+ 1 {key}
+ keys:
+ 0 _col2 (type: string)
+ 1 key (type: string)
Stage: Stage-4
Map Reduce
@@ -1980,22 +2214,6 @@ STAGE PLANS:
value expressions: _col0 (type: bigint), _col1 (type: bigint), _col2 (type: bigint), _col3 (type: bigint), _col4 (type: bigint), _col5 (type: bigint), _col6 (type: bigint), _col7 (type: bigint)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:smalltbl3
- Fetch Operator
- limit: -1
- smalltbl4
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:smalltbl3
- TableScan
- alias: smalltbl3
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
- smalltbl4
- TableScan
- alias: smalltbl4
- Statistics: Num rows: 10 Data size: 70 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
aggregations: sum(VALUE._col0), sum(VALUE._col1), sum(VALUE._col2), sum(VALUE._col3), sum(VALUE._col4), sum(VALUE._col5), sum(VALUE._col6), sum(VALUE._col7)
@@ -2107,7 +2325,9 @@ POSTHOOK: Lineage: smalltbl3.key SIMPLE
POSTHOOK: Lineage: smalltbl3.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
+RUN: Stage-14:MAPREDLOCAL
RUN: Stage-11:MAPRED
+RUN: Stage-13:MAPREDLOCAL
RUN: Stage-4:MAPRED
247580 247580 247580 247580 247580 247580 548662743780 548662743780
PREHOOK: query: -- Enable noconditionaltask and but set the size of hive.auto.convert.join.noconditionaltask.size
@@ -2194,22 +2414,30 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-20 is a root stage , consists of Stage-18, Stage-19, Stage-5
- Stage-18 has a backup stage: Stage-5
- Stage-17 depends on stages: Stage-5, Stage-18, Stage-19 , consists of Stage-15, Stage-16, Stage-1
- Stage-15 has a backup stage: Stage-1
- Stage-14 depends on stages: Stage-1, Stage-15, Stage-16 , consists of Stage-12, Stage-13, Stage-2
- Stage-12 has a backup stage: Stage-2
- Stage-11 depends on stages: Stage-2, Stage-12, Stage-13 , consists of Stage-9, Stage-10, Stage-3
- Stage-9 has a backup stage: Stage-3
+ Stage-20 is a root stage , consists of Stage-27, Stage-28, Stage-5
+ Stage-27 has a backup stage: Stage-5
+ Stage-18 depends on stages: Stage-27
+ Stage-17 depends on stages: Stage-5, Stage-18, Stage-19 , consists of Stage-25, Stage-26, Stage-1
+ Stage-25 has a backup stage: Stage-1
+ Stage-15 depends on stages: Stage-25
+ Stage-14 depends on stages: Stage-1, Stage-15, Stage-16 , consists of Stage-23, Stage-24, Stage-2
+ Stage-23 has a backup stage: Stage-2
+ Stage-12 depends on stages: Stage-23
+ Stage-11 depends on stages: Stage-2, Stage-12, Stage-13 , consists of Stage-21, Stage-22, Stage-3
+ Stage-21 has a backup stage: Stage-3
+ Stage-9 depends on stages: Stage-21
Stage-4 depends on stages: Stage-3, Stage-9, Stage-10
- Stage-10 has a backup stage: Stage-3
+ Stage-22 has a backup stage: Stage-3
+ Stage-10 depends on stages: Stage-22
Stage-3
- Stage-13 has a backup stage: Stage-2
+ Stage-24 has a backup stage: Stage-2
+ Stage-13 depends on stages: Stage-24
Stage-2
- Stage-16 has a backup stage: Stage-1
+ Stage-26 has a backup stage: Stage-1
+ Stage-16 depends on stages: Stage-26
Stage-1
- Stage-19 has a backup stage: Stage-5
+ Stage-28 has a backup stage: Stage-5
+ Stage-19 depends on stages: Stage-28
Stage-5
Stage-0 is a root stage
@@ -2217,6 +2445,24 @@ STAGE PLANS:
Stage: Stage-20
Conditional Operator
+ Stage: Stage-27
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:join1:smalltbl1
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:join1:smalltbl1
+ TableScan
+ alias: smalltbl1
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key1} {key2} {value}
+ 1 {key}
+ keys:
+ 0 key1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-18
Map Reduce
Map Operator Tree:
@@ -2243,18 +2489,28 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:join1:smalltbl1
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:join1:smalltbl1
- TableScan
- alias: smalltbl1
Stage: Stage-17
Conditional Operator
+ Stage: Stage-25
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:smalltbl2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:smalltbl2
+ TableScan
+ alias: smalltbl2
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4}
+ 1 {key}
+ keys:
+ 0 _col3 (type: string)
+ 1 value (type: string)
+
Stage: Stage-15
Map Reduce
Map Operator Tree:
@@ -2280,18 +2536,28 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:smalltbl2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:smalltbl2
- TableScan
- alias: smalltbl2
Stage: Stage-14
Conditional Operator
+ Stage: Stage-23
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:smalltbl3
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:smalltbl3
+ TableScan
+ alias: smalltbl3
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5}
+ 1 {key}
+ keys:
+ 0 _col1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-12
Map Reduce
Map Operator Tree:
@@ -2317,18 +2583,28 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:smalltbl3
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:smalltbl3
- TableScan
- alias: smalltbl3
Stage: Stage-11
Conditional Operator
+ Stage: Stage-21
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ smalltbl4
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ smalltbl4
+ TableScan
+ alias: smalltbl4
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5} {_col6}
+ 1 {key}
+ keys:
+ 0 _col2 (type: string)
+ 1 key (type: string)
+
Stage: Stage-9
Map Reduce
Map Operator Tree:
@@ -2358,14 +2634,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- smalltbl4
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- smalltbl4
- TableScan
- alias: smalltbl4
Stage: Stage-4
Map Reduce
@@ -2393,6 +2661,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ Stage: Stage-22
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ $INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ $INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5} {_col6}
+ 1 {key}
+ keys:
+ 0 _col2 (type: string)
+ 1 key (type: string)
+
Stage: Stage-10
Map Reduce
Map Operator Tree:
@@ -2423,13 +2708,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- $INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- $INTNAME
- TableScan
Stage: Stage-3
Map Reduce
@@ -2475,6 +2753,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-24
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:$INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:$INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4} {_col5}
+ 1 {key}
+ keys:
+ 0 _col1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-13
Map Reduce
Map Operator Tree:
@@ -2501,13 +2796,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:$INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:$INTNAME
- TableScan
Stage: Stage-2
Map Reduce
@@ -2548,6 +2836,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-26
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:$INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:$INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1} {_col2} {_col3} {_col4}
+ 1 {key}
+ keys:
+ 0 _col3 (type: string)
+ 1 value (type: string)
+
Stage: Stage-16
Map Reduce
Map Operator Tree:
@@ -2574,13 +2879,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:$INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:$INTNAME
- TableScan
Stage: Stage-1
Map Reduce
@@ -2621,6 +2919,24 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-28
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ join3:join2:join1:bigtbl
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ join3:join2:join1:bigtbl
+ TableScan
+ alias: bigtbl
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key1} {key2} {value}
+ 1 {key}
+ keys:
+ 0 key1 (type: string)
+ 1 key (type: string)
+
Stage: Stage-19
Map Reduce
Map Operator Tree:
@@ -2647,14 +2963,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- join3:join2:join1:bigtbl
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- join3:join2:join1:bigtbl
- TableScan
- alias: bigtbl
Stage: Stage-5
Map Reduce
@@ -2791,12 +3099,16 @@ POSTHOOK: Lineage: smalltbl3.value SIMPL
POSTHOOK: Lineage: smalltbl4.key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: smalltbl4.value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
RUN: Stage-20:CONDITIONAL
+RUN: Stage-27:MAPREDLOCAL
RUN: Stage-18:MAPRED
RUN: Stage-17:CONDITIONAL
+RUN: Stage-25:MAPREDLOCAL
RUN: Stage-15:MAPRED
RUN: Stage-14:CONDITIONAL
+RUN: Stage-23:MAPREDLOCAL
RUN: Stage-12:MAPRED
RUN: Stage-11:CONDITIONAL
+RUN: Stage-21:MAPREDLOCAL
RUN: Stage-9:MAPRED
RUN: Stage-4:MAPRED
247580 247580 247580 247580 247580 247580 548662743780 548662743780
Modified: hive/trunk/ql/src/test/results/clientpositive/multiMapJoin2.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/multiMapJoin2.q.out?rev=1584410&r1=1584409&r2=1584410&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/multiMapJoin2.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/multiMapJoin2.q.out Thu Apr 3 21:40:21 2014
@@ -15,10 +15,44 @@ FROM (SELECT x1.key AS key FROM src x1 J
ORDER BY tmp.key
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-2 is a root stage
+ Stage-8 is a root stage
+ Stage-2 depends on stages: Stage-8
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-8
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ null-subquery1:tmp-subquery1:y1
+ Fetch Operator
+ limit: -1
+ null-subquery2:tmp-subquery2:y2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ null-subquery1:tmp-subquery1:y1
+ TableScan
+ alias: y1
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+ null-subquery2:tmp-subquery2:y2
+ TableScan
+ alias: y2
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -82,22 +116,6 @@ STAGE PLANS:
value expressions: _col0 (type: string)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- null-subquery1:tmp-subquery1:y1
- Fetch Operator
- limit: -1
- null-subquery2:tmp-subquery2:y2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- null-subquery1:tmp-subquery1:y1
- TableScan
- alias: y1
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
- null-subquery2:tmp-subquery2:y2
- TableScan
- alias: y2
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Extract
Statistics: Num rows: 126 Data size: 12786 Basic stats: COMPLETE Column stats: NONE
@@ -131,6 +149,7 @@ POSTHOOK: type: QUERY
POSTHOOK: Input: default@src
POSTHOOK: Input: default@src1
#### A masked pattern was here ####
+RUN: Stage-8:MAPREDLOCAL
RUN: Stage-2:MAPRED
128
128
@@ -235,11 +254,32 @@ FROM (SELECT x1.key AS key FROM src x1 J
ORDER BY tmp.key
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-7 is a root stage
- Stage-2 depends on stages: Stage-7
+ Stage-9 is a root stage
+ Stage-7 depends on stages: Stage-9
+ Stage-8 depends on stages: Stage-7
+ Stage-2 depends on stages: Stage-8
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-9
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ null-subquery1:tmp-subquery1:y1
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ null-subquery1:tmp-subquery1:y1
+ TableScan
+ alias: y1
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-7
Map Reduce
Map Operator Tree:
@@ -269,15 +309,25 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- null-subquery1:tmp-subquery1:y1
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- null-subquery1:tmp-subquery1:y1
- TableScan
- alias: y1
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+
+ Stage: Stage-8
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ null-subquery2:tmp-subquery2:y2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ null-subquery2:tmp-subquery2:y2
+ TableScan
+ alias: y2
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
Stage: Stage-2
Map Reduce
@@ -325,15 +375,6 @@ STAGE PLANS:
value expressions: _col0 (type: string)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- null-subquery2:tmp-subquery2:y2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- null-subquery2:tmp-subquery2:y2
- TableScan
- alias: y2
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Extract
Statistics: Num rows: 126 Data size: 12786 Basic stats: COMPLETE Column stats: NONE
@@ -367,7 +408,9 @@ POSTHOOK: type: QUERY
POSTHOOK: Input: default@src
POSTHOOK: Input: default@src1
#### A masked pattern was here ####
+RUN: Stage-9:MAPREDLOCAL
RUN: Stage-7:MAPRED
+RUN: Stage-8:MAPREDLOCAL
RUN: Stage-2:MAPRED
128
128
@@ -467,7 +510,8 @@ ORDER BY tmp.key
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
Stage-4 is a root stage
- Stage-2 depends on stages: Stage-4
+ Stage-6 depends on stages: Stage-4
+ Stage-2 depends on stages: Stage-6
Stage-0 is a root stage
STAGE PLANS:
@@ -508,6 +552,25 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-6
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ null-subquery2:tmp-subquery2:y2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ null-subquery2:tmp-subquery2:y2
+ TableScan
+ alias: y2
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -554,15 +617,6 @@ STAGE PLANS:
value expressions: _col0 (type: string)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- null-subquery2:tmp-subquery2:y2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- null-subquery2:tmp-subquery2:y2
- TableScan
- alias: y2
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Extract
Statistics: Num rows: 64 Data size: 6501 Basic stats: COMPLETE Column stats: NONE
@@ -597,6 +651,7 @@ POSTHOOK: Input: default@src
POSTHOOK: Input: default@src1
#### A masked pattern was here ####
RUN: Stage-4:MAPRED
+RUN: Stage-6:MAPREDLOCAL
RUN: Stage-2:MAPRED
128
@@ -690,17 +745,40 @@ GROUP BY tmp1.key
ORDER BY key, cnt
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-2 is a root stage
- Stage-12 depends on stages: Stage-2, Stage-8 , consists of Stage-10, Stage-11, Stage-3
- Stage-10 has a backup stage: Stage-3
+ Stage-17 is a root stage
+ Stage-2 depends on stages: Stage-17
+ Stage-12 depends on stages: Stage-2, Stage-8 , consists of Stage-15, Stage-16, Stage-3
+ Stage-15 has a backup stage: Stage-3
+ Stage-10 depends on stages: Stage-15
Stage-4 depends on stages: Stage-3, Stage-10, Stage-11
Stage-5 depends on stages: Stage-4
- Stage-11 has a backup stage: Stage-3
+ Stage-16 has a backup stage: Stage-3
+ Stage-11 depends on stages: Stage-16
Stage-3
- Stage-8 is a root stage
+ Stage-18 is a root stage
+ Stage-8 depends on stages: Stage-18
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-17
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp2:y2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp2:y2
+ TableScan
+ alias: y2
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -734,15 +812,6 @@ STAGE PLANS:
Statistics: Num rows: 63 Data size: 6393 Basic stats: COMPLETE Column stats: NONE
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp2:y2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp2:y2
- TableScan
- alias: y2
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
keys: KEY._col0 (type: string)
@@ -763,6 +832,23 @@ STAGE PLANS:
Stage: Stage-12
Conditional Operator
+ Stage: Stage-15
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ $INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ $INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0}
+ 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+
Stage: Stage-10
Map Reduce
Map Operator Tree:
@@ -793,13 +879,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- $INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- $INTNAME
- TableScan
Stage: Stage-4
Map Reduce
@@ -849,6 +928,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ Stage: Stage-16
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ $INTNAME1
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ $INTNAME1
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0}
+ 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+
Stage: Stage-11
Map Reduce
Map Operator Tree:
@@ -879,13 +975,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- $INTNAME1
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- $INTNAME1
- TableScan
Stage: Stage-3
Map Reduce
@@ -929,6 +1018,25 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-18
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp1:y1
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp1:y1
+ TableScan
+ alias: y1
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-8
Map Reduce
Map Operator Tree:
@@ -962,15 +1070,6 @@ STAGE PLANS:
Statistics: Num rows: 63 Data size: 6393 Basic stats: COMPLETE Column stats: NONE
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp1:y1
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp1:y1
- TableScan
- alias: y1
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
keys: KEY._col0 (type: string)
@@ -1020,9 +1119,12 @@ POSTHOOK: type: QUERY
POSTHOOK: Input: default@src
POSTHOOK: Input: default@src1
#### A masked pattern was here ####
+RUN: Stage-17:MAPREDLOCAL
+RUN: Stage-18:MAPREDLOCAL
RUN: Stage-2:MAPRED
RUN: Stage-8:MAPRED
RUN: Stage-12:CONDITIONAL
+RUN: Stage-16:MAPREDLOCAL
RUN: Stage-11:MAPRED
RUN: Stage-4:MAPRED
RUN: Stage-5:MAPRED
@@ -1074,11 +1176,45 @@ GROUP BY tmp1.key
ORDER BY key, cnt
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-2 is a root stage
+ Stage-9 is a root stage
+ Stage-2 depends on stages: Stage-9
Stage-3 depends on stages: Stage-2
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-9
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp1:y1
+ Fetch Operator
+ limit: -1
+ tmp2:y2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp1:y1
+ TableScan
+ alias: y1
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+ tmp2:y2
+ TableScan
+ alias: y2
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -1140,22 +1276,6 @@ STAGE PLANS:
Statistics: Num rows: 63 Data size: 6393 Basic stats: COMPLETE Column stats: NONE
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp1:y1
- Fetch Operator
- limit: -1
- tmp2:y2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp1:y1
- TableScan
- alias: y1
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
- tmp2:y2
- TableScan
- alias: y2
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Demux Operator
Statistics: Num rows: 126 Data size: 12786 Basic stats: COMPLETE Column stats: NONE
@@ -1294,6 +1414,7 @@ POSTHOOK: type: QUERY
POSTHOOK: Input: default@src
POSTHOOK: Input: default@src1
#### A masked pattern was here ####
+RUN: Stage-9:MAPREDLOCAL
RUN: Stage-2:MAPRED
RUN: Stage-3:MAPRED
128 1
@@ -1351,13 +1472,16 @@ ORDER BY key, cnt
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
Stage-7 is a root stage
- Stage-10 depends on stages: Stage-2, Stage-7 , consists of Stage-8, Stage-9, Stage-3
- Stage-8 has a backup stage: Stage-3
+ Stage-10 depends on stages: Stage-2, Stage-7 , consists of Stage-12, Stage-13, Stage-3
+ Stage-12 has a backup stage: Stage-3
+ Stage-8 depends on stages: Stage-12
Stage-4 depends on stages: Stage-3, Stage-8, Stage-9
Stage-5 depends on stages: Stage-4
- Stage-9 has a backup stage: Stage-3
+ Stage-13 has a backup stage: Stage-3
+ Stage-9 depends on stages: Stage-13
Stage-3
- Stage-2 is a root stage
+ Stage-14 is a root stage
+ Stage-2 depends on stages: Stage-14
Stage-0 is a root stage
STAGE PLANS:
@@ -1401,6 +1525,23 @@ STAGE PLANS:
Stage: Stage-10
Conditional Operator
+ Stage: Stage-12
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ $INTNAME
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ $INTNAME
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0}
+ 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+
Stage: Stage-8
Map Reduce
Map Operator Tree:
@@ -1431,13 +1572,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- $INTNAME
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- $INTNAME
- TableScan
Stage: Stage-4
Map Reduce
@@ -1487,6 +1621,23 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ Stage: Stage-13
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ $INTNAME1
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ $INTNAME1
+ TableScan
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0}
+ 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+
Stage: Stage-9
Map Reduce
Map Operator Tree:
@@ -1517,13 +1668,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- $INTNAME1
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- $INTNAME1
- TableScan
Stage: Stage-3
Map Reduce
@@ -1567,6 +1711,25 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-14
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp2:y2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp2:y2
+ TableScan
+ alias: y2
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -1600,15 +1763,6 @@ STAGE PLANS:
Statistics: Num rows: 63 Data size: 6393 Basic stats: COMPLETE Column stats: NONE
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp2:y2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp2:y2
- TableScan
- alias: y2
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
keys: KEY._col0 (type: string)
@@ -1659,8 +1813,10 @@ POSTHOOK: Input: default@src
POSTHOOK: Input: default@src1
#### A masked pattern was here ####
RUN: Stage-7:MAPRED
+RUN: Stage-14:MAPREDLOCAL
RUN: Stage-2:MAPRED
RUN: Stage-10:CONDITIONAL
+RUN: Stage-12:MAPREDLOCAL
RUN: Stage-8:MAPRED
RUN: Stage-4:MAPRED
RUN: Stage-5:MAPRED
@@ -1712,11 +1868,31 @@ GROUP BY tmp1.key
ORDER BY key, cnt
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-2 is a root stage
+ Stage-7 is a root stage
+ Stage-2 depends on stages: Stage-7
Stage-3 depends on stages: Stage-2
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-7
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ tmp2:y2
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ tmp2:y2
+ TableScan
+ alias: y2
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -1767,15 +1943,6 @@ STAGE PLANS:
Statistics: Num rows: 63 Data size: 6393 Basic stats: COMPLETE Column stats: NONE
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- tmp2:y2
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- tmp2:y2
- TableScan
- alias: y2
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Demux Operator
Statistics: Num rows: 65 Data size: 6609 Basic stats: COMPLETE Column stats: NONE
@@ -1914,6 +2081,7 @@ POSTHOOK: type: QUERY
POSTHOOK: Input: default@src
POSTHOOK: Input: default@src1
#### A masked pattern was here ####
+RUN: Stage-7:MAPREDLOCAL
RUN: Stage-2:MAPRED
RUN: Stage-3:MAPRED
128 1
@@ -1986,10 +2154,30 @@ POSTHOOK: Lineage: part_table PARTITION(
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).key SIMPLE [(src1)src1.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).value SIMPLE [(src1)src1.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-2 is a root stage
+ Stage-5 is a root stage
+ Stage-2 depends on stages: Stage-5
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-5
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ y
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ y
+ TableScan
+ alias: y
+ Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -2019,15 +2207,6 @@ STAGE PLANS:
value expressions: _col0 (type: bigint)
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- y
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- y
- TableScan
- alias: y
- Statistics: Num rows: 2 Data size: 216 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
aggregations: count(VALUE._col0)
@@ -2070,6 +2249,7 @@ POSTHOOK: Lineage: part_table PARTITION(
POSTHOOK: Lineage: part_table PARTITION(partitionid=1).value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).key SIMPLE [(src1)src1.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).value SIMPLE [(src1)src1.FieldSchema(name:value, type:string, comment:default), ]
+RUN: Stage-5:MAPREDLOCAL
RUN: Stage-2:MAPRED
121
PREHOOK: query: -- HIVE-5891 Alias conflict when merging multiple mapjoin tasks into their common
@@ -2103,12 +2283,34 @@ POSTHOOK: Lineage: part_table PARTITION(
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).key SIMPLE [(src1)src1.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).value SIMPLE [(src1)src1.FieldSchema(name:value, type:string, comment:default), ]
STAGE DEPENDENCIES:
- Stage-2 is a root stage
- Stage-4 depends on stages: Stage-2, Stage-7
- Stage-7 is a root stage
+ Stage-17 is a root stage
+ Stage-2 depends on stages: Stage-17
+ Stage-16 depends on stages: Stage-2, Stage-7
+ Stage-4 depends on stages: Stage-16
+ Stage-18 is a root stage
+ Stage-7 depends on stages: Stage-18
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-17
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ null-subquery2:x-subquery2:tmp:a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ null-subquery2:x-subquery2:tmp:a
+ TableScan
+ alias: a
+ Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-2
Map Reduce
Map Operator Tree:
@@ -2142,15 +2344,6 @@ STAGE PLANS:
Statistics: Num rows: 63 Data size: 6393 Basic stats: COMPLETE Column stats: NONE
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- null-subquery2:x-subquery2:tmp:a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- null-subquery2:x-subquery2:tmp:a
- TableScan
- alias: a
- Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
keys: KEY._col0 (type: string)
@@ -2168,6 +2361,39 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-16
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ null-subquery1:x-subquery1:c
+ Fetch Operator
+ limit: -1
+ null-subquery2:x-subquery2:c
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ null-subquery1:x-subquery1:c
+ TableScan
+ alias: c
+ Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0
+ 1 {key}
+ keys:
+ 0 _col0 (type: string)
+ 1 key (type: string)
+ null-subquery2:x-subquery2:c
+ TableScan
+ alias: c
+ Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0
+ 1 {key}
+ keys:
+ 0 _col0 (type: string)
+ 1 key (type: string)
+
Stage: Stage-4
Map Reduce
Map Operator Tree:
@@ -2231,22 +2457,25 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- null-subquery1:x-subquery1:c
- Fetch Operator
- limit: -1
- null-subquery2:x-subquery2:c
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- null-subquery1:x-subquery1:c
- TableScan
- alias: c
- Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
- null-subquery2:x-subquery2:c
- TableScan
- alias: c
- Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+
+ Stage: Stage-18
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ null-subquery1:x-subquery1:tmp:a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ null-subquery1:x-subquery1:tmp:a
+ TableScan
+ alias: a
+ Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
Stage: Stage-7
Map Reduce
@@ -2281,15 +2510,6 @@ STAGE PLANS:
Statistics: Num rows: 63 Data size: 6393 Basic stats: COMPLETE Column stats: NONE
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- null-subquery1:x-subquery1:tmp:a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- null-subquery1:x-subquery1:tmp:a
- TableScan
- alias: a
- Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Group By Operator
keys: KEY._col0 (type: string)
@@ -2339,8 +2559,11 @@ POSTHOOK: Lineage: part_table PARTITION(
POSTHOOK: Lineage: part_table PARTITION(partitionid=1).value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).key SIMPLE [(src1)src1.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: part_table PARTITION(partitionid=2).value SIMPLE [(src1)src1.FieldSchema(name:value, type:string, comment:default), ]
+RUN: Stage-17:MAPREDLOCAL
+RUN: Stage-18:MAPREDLOCAL
RUN: Stage-2:MAPRED
RUN: Stage-7:MAPRED
+RUN: Stage-16:MAPREDLOCAL
RUN: Stage-4:MAPRED
0
0
Modified: hive/trunk/ql/src/test/results/clientpositive/multi_join_union.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/multi_join_union.q.out?rev=1584410&r1=1584409&r2=1584410&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/multi_join_union.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/multi_join_union.q.out Thu Apr 3 21:40:21 2014
@@ -45,6 +45,9 @@ STAGE PLANS:
Stage: Stage-8
Map Reduce Local Work
Alias -> Map Local Tables:
+ a
+ Fetch Operator
+ limit: -1
c-subquery1:a-subquery1:src13
Fetch Operator
limit: -1
@@ -52,6 +55,17 @@ STAGE PLANS:
Fetch Operator
limit: -1
Alias -> Map Local Operator Tree:
+ a
+ TableScan
+ alias: a
+ Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key} {value}
+ 1 {key} {value}
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
c-subquery1:a-subquery1:src13
TableScan
alias: src13
@@ -136,19 +150,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- a
- Fetch Operator
- limit: -1
- c-subquery1:a-subquery1:src13
- c-subquery2:a-subquery2:src14
- Alias -> Map Local Operator Tree:
- a
- TableScan
- alias: a
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- c-subquery1:a-subquery1:src13
- c-subquery2:a-subquery2:src14
Stage: Stage-0
Fetch Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/reduce_deduplicate_exclude_join.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/reduce_deduplicate_exclude_join.q.out?rev=1584410&r1=1584409&r2=1584410&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/reduce_deduplicate_exclude_join.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/reduce_deduplicate_exclude_join.q.out Thu Apr 3 21:40:21 2014
@@ -4,7 +4,8 @@ POSTHOOK: query: explain select * from (
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
Stage-2 is a root stage
- Stage-3 depends on stages: Stage-2
+ Stage-4 depends on stages: Stage-2
+ Stage-3 depends on stages: Stage-4
Stage-0 is a root stage
STAGE PLANS:
@@ -34,6 +35,25 @@ STAGE PLANS:
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
serde: org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe
+ Stage: Stage-4
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ b
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ b
+ TableScan
+ alias: b
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {_col0} {_col1}
+ 1 {key} {value}
+ keys:
+ 0 _col0 (type: string)
+ 1 key (type: string)
+
Stage: Stage-3
Map Reduce
Map Operator Tree:
@@ -65,15 +85,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- b
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- b
- TableScan
- alias: b
- Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Stage: Stage-0
Fetch Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/select_transform_hint.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/select_transform_hint.q.out?rev=1584410&r1=1584409&r2=1584410&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/select_transform_hint.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/select_transform_hint.q.out Thu Apr 3 21:40:21 2014
@@ -11,10 +11,30 @@ FROM src a join src b
on a.key = b.key
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-1 is a root stage
+ Stage-3 is a root stage
+ Stage-1 depends on stages: Stage-3
Stage-0 is a root stage
STAGE PLANS:
+ Stage: Stage-3
+ Map Reduce Local Work
+ Alias -> Map Local Tables:
+ a
+ Fetch Operator
+ limit: -1
+ Alias -> Map Local Operator Tree:
+ a
+ TableScan
+ alias: a
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ HashTable Sink Operator
+ condition expressions:
+ 0 {key} {value}
+ 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+
Stage: Stage-1
Map Reduce
Map Operator Tree:
@@ -52,15 +72,6 @@ STAGE PLANS:
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Local Work:
Map Reduce Local Work
- Alias -> Map Local Tables:
- a
- Fetch Operator
- limit: -1
- Alias -> Map Local Operator Tree:
- a
- TableScan
- alias: a
- Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Stage: Stage-0
Fetch Operator