You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by gu...@apache.org on 2015/12/22 20:45:13 UTC
[2/3] hive git commit: HIVE-12667: Proper fix for HIVE-12473 (Gunther
Hagleitner, reviewed by Vikram Dixit K)
http://git-wip-us.apache.org/repos/asf/hive/blob/45ae30c8/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out
----------------------------------------------------------------------
diff --git a/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out b/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out
index 2464076..63121a9 100644
--- a/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out
+++ b/ql/src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out
@@ -248,10 +248,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -503,10 +503,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Map 6
@@ -537,10 +537,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -849,10 +849,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col2 (type: string)
@@ -864,10 +864,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -1114,10 +1114,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -1362,10 +1362,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: UDFToDouble(hr)
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -1488,10 +1488,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: (UDFToDouble(hr) * 2.0)
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -1849,10 +1849,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: UDFToString((UDFToDouble(hr) * 2.0))
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -2041,10 +2041,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Stage: Stage-0
@@ -2262,10 +2262,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col2 (type: string)
@@ -2277,10 +2277,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -2405,10 +2405,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -2496,10 +2496,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 4
Execution mode: vectorized, llap
Map 4
@@ -2619,10 +2619,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -2730,10 +2730,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Map 6
@@ -3112,10 +3112,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 8
Execution mode: vectorized, uber
@@ -3148,10 +3148,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Union 6
Vertex: Union 6
@@ -3318,10 +3318,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 8
Execution mode: vectorized, uber
@@ -3354,10 +3354,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Union 6
Vertex: Union 6
@@ -3508,10 +3508,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col0 (type: string)
@@ -3523,10 +3523,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 5
Reducer 2
Execution mode: vectorized, uber
@@ -3603,10 +3603,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col0 (type: string)
@@ -3618,10 +3618,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 5
Union 3
Vertex: Union 3
@@ -3730,10 +3730,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -3878,10 +3878,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Map 4
@@ -3912,10 +3912,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 172 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -4049,10 +4049,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col2 (type: string)
@@ -4064,10 +4064,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 360 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -4198,10 +4198,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -4308,10 +4308,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: UDFToDouble(hr)
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -4429,10 +4429,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: (UDFToDouble(hr) * 2.0)
Statistics: Num rows: 1 Data size: 94 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -4699,10 +4699,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Reducer 2
@@ -4988,10 +4988,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Execution mode: vectorized, llap
Map 4
@@ -5315,10 +5315,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 7
Execution mode: vectorized, uber
@@ -5351,10 +5351,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Union 5
Vertex: Union 5
@@ -5493,10 +5493,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart_orc
Partition key expr: ds
Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: UDFToDouble(_col2) (type: double)
@@ -5508,10 +5508,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (int)
Target Input: srcpart_orc
Partition key expr: UDFToDouble(hr)
Statistics: Num rows: 2 Data size: 720 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Execution mode: llap
Reducer 2
http://git-wip-us.apache.org/repos/asf/hive/blob/45ae30c8/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out
----------------------------------------------------------------------
diff --git a/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out b/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out
index 9582334..36f4eb7 100644
--- a/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out
+++ b/ql/src/test/results/clientpositive/tez/bucket_map_join_tez1.q.out
@@ -1423,10 +1423,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 242 Data size: 2566 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: b
Partition key expr: ds
Statistics: Num rows: 242 Data size: 2566 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 2
Map 2
Map Operator Tree:
http://git-wip-us.apache.org/repos/asf/hive/blob/45ae30c8/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out
----------------------------------------------------------------------
diff --git a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out
index caa4398..58ab2c0 100644
--- a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out
+++ b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning.q.out
@@ -245,10 +245,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -428,6 +428,237 @@ POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
#### A masked pattern was here ####
1000
+PREHOOK: query: -- single column, single key, udf with typechange
+EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+PREHOOK: type: QUERY
+POSTHOOK: query: -- single column, single key, udf with typechange
+EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+POSTHOOK: type: QUERY
+STAGE DEPENDENCIES:
+ Stage-1 is a root stage
+ Stage-0 depends on stages: Stage-1
+
+STAGE PLANS:
+ Stage: Stage-1
+ Tez
+ Edges:
+ Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE)
+ Reducer 3 <- Reducer 2 (SIMPLE_EDGE)
+#### A masked pattern was here ####
+ Vertices:
+ Map 1
+ Map Operator Tree:
+ TableScan
+ alias: srcpart
+ filterExpr: ds is not null (type: boolean)
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: ds (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: day(_col0) (type: int)
+ sort order: +
+ Map-reduce partition columns: day(_col0) (type: int)
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Map 4
+ Map Operator Tree:
+ TableScan
+ alias: srcpart_date
+ filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean)
+ Statistics: Num rows: 2 Data size: 42 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: ((date = '2008-04-08') and ds is not null) (type: boolean)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: ds (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: day(_col0) (type: int)
+ sort order: +
+ Map-reduce partition columns: day(_col0) (type: int)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: day(_col0) (type: int)
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Group By Operator
+ keys: _col0 (type: int)
+ mode: hash
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Dynamic Partitioning Event Operator
+ Target column: ds (string)
+ Target Input: srcpart
+ Partition key expr: day(ds)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Target Vertex: Map 1
+ Reducer 2
+ Reduce Operator Tree:
+ Merge Join Operator
+ condition map:
+ Inner Join 0 to 1
+ keys:
+ 0 day(_col0) (type: int)
+ 1 day(_col0) (type: int)
+ Statistics: Num rows: 2200 Data size: 23372 Basic stats: COMPLETE Column stats: NONE
+ Group By Operator
+ aggregations: count()
+ mode: hash
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ sort order:
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: bigint)
+ Reducer 3
+ Reduce Operator Tree:
+ Group By Operator
+ aggregations: count(VALUE._col0)
+ mode: mergepartial
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ Stage: Stage-0
+ Fetch Operator
+ limit: -1
+ Processor Tree:
+ ListSink
+
+PREHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+PREHOOK: type: QUERY
+PREHOOK: Input: default@srcpart
+PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
+PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
+PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
+PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
+PREHOOK: Input: default@srcpart_date
+#### A masked pattern was here ####
+POSTHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+POSTHOOK: type: QUERY
+POSTHOOK: Input: default@srcpart
+POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
+POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
+POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
+POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
+POSTHOOK: Input: default@srcpart_date
+#### A masked pattern was here ####
+1000
+PREHOOK: query: EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+PREHOOK: type: QUERY
+POSTHOOK: query: EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+POSTHOOK: type: QUERY
+STAGE DEPENDENCIES:
+ Stage-1 is a root stage
+ Stage-0 depends on stages: Stage-1
+
+STAGE PLANS:
+ Stage: Stage-1
+ Tez
+ Edges:
+ Reducer 2 <- Map 1 (SIMPLE_EDGE), Map 4 (SIMPLE_EDGE)
+ Reducer 3 <- Reducer 2 (SIMPLE_EDGE)
+#### A masked pattern was here ####
+ Vertices:
+ Map 1
+ Map Operator Tree:
+ TableScan
+ alias: srcpart
+ filterExpr: ds is not null (type: boolean)
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: ds (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: day(_col0) (type: int)
+ sort order: +
+ Map-reduce partition columns: day(_col0) (type: int)
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Map 4
+ Map Operator Tree:
+ TableScan
+ alias: srcpart_date
+ filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean)
+ Statistics: Num rows: 2 Data size: 42 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: ((date = '2008-04-08') and ds is not null) (type: boolean)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: ds (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: day(_col0) (type: int)
+ sort order: +
+ Map-reduce partition columns: day(_col0) (type: int)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Reducer 2
+ Reduce Operator Tree:
+ Merge Join Operator
+ condition map:
+ Inner Join 0 to 1
+ keys:
+ 0 day(_col0) (type: int)
+ 1 day(_col0) (type: int)
+ Statistics: Num rows: 2200 Data size: 23372 Basic stats: COMPLETE Column stats: NONE
+ Group By Operator
+ aggregations: count()
+ mode: hash
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ sort order:
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: bigint)
+ Reducer 3
+ Reduce Operator Tree:
+ Group By Operator
+ aggregations: count(VALUE._col0)
+ mode: mergepartial
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ Stage: Stage-0
+ Fetch Operator
+ limit: -1
+ Processor Tree:
+ ListSink
+
+PREHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+PREHOOK: type: QUERY
+PREHOOK: Input: default@srcpart
+PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
+PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
+PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
+PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
+PREHOOK: Input: default@srcpart_date
+#### A masked pattern was here ####
+POSTHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+POSTHOOK: type: QUERY
+POSTHOOK: Input: default@srcpart
+POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
+POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
+POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
+POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
+POSTHOOK: Input: default@srcpart_date
+#### A masked pattern was here ####
+1000
PREHOOK: query: -- multiple sources, single key
EXPLAIN select count(*) from srcpart join srcpart_date on (srcpart.ds = srcpart_date.ds) join srcpart_hour on (srcpart.hr = srcpart_hour.hr)
where srcpart_date.`date` = '2008-04-08' and srcpart_hour.hour = 11
@@ -492,10 +723,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Map 6
Map Operator Tree:
@@ -525,10 +756,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -826,10 +1057,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col2 (type: string)
@@ -841,10 +1072,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -1083,10 +1314,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -1323,10 +1554,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: UDFToDouble(hr)
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -1445,10 +1676,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: (UDFToDouble(hr) * 2.0)
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -1794,10 +2025,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: UDFToString((UDFToDouble(hr) * 2.0))
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -1978,10 +2209,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Stage: Stage-0
@@ -2194,10 +2425,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col2 (type: string)
@@ -2209,10 +2440,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -2333,10 +2564,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -2421,10 +2652,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 4
Map 4
Map Operator Tree:
@@ -2539,10 +2770,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -2646,10 +2877,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Map 6
Map Operator Tree:
@@ -3011,10 +3242,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 8
Reduce Operator Tree:
@@ -3046,10 +3277,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Union 6
Vertex: Union 6
@@ -3210,10 +3441,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 8
Reduce Operator Tree:
@@ -3245,10 +3476,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Union 6
Vertex: Union 6
@@ -3394,10 +3625,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col0 (type: string)
@@ -3409,10 +3640,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 5
Reducer 2
Reduce Operator Tree:
@@ -3485,10 +3716,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col0 (type: string)
@@ -3500,10 +3731,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 5
Union 3
Vertex: Union 3
@@ -3611,10 +3842,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -3669,6 +3900,126 @@ POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
#### A masked pattern was here ####
1000
+PREHOOK: query: -- single column, single key, udf with typechange
+EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+PREHOOK: type: QUERY
+POSTHOOK: query: -- single column, single key, udf with typechange
+EXPLAIN select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+POSTHOOK: type: QUERY
+STAGE DEPENDENCIES:
+ Stage-1 is a root stage
+ Stage-0 depends on stages: Stage-1
+
+STAGE PLANS:
+ Stage: Stage-1
+ Tez
+ Edges:
+ Map 1 <- Map 3 (BROADCAST_EDGE)
+ Reducer 2 <- Map 1 (SIMPLE_EDGE)
+#### A masked pattern was here ####
+ Vertices:
+ Map 1
+ Map Operator Tree:
+ TableScan
+ alias: srcpart
+ filterExpr: ds is not null (type: boolean)
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: ds (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 2000 Data size: 21248 Basic stats: COMPLETE Column stats: NONE
+ Map Join Operator
+ condition map:
+ Inner Join 0 to 1
+ keys:
+ 0 day(_col0) (type: int)
+ 1 day(_col0) (type: int)
+ input vertices:
+ 1 Map 3
+ Statistics: Num rows: 2200 Data size: 23372 Basic stats: COMPLETE Column stats: NONE
+ HybridGraceHashJoin: true
+ Group By Operator
+ aggregations: count()
+ mode: hash
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ sort order:
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: bigint)
+ Map 3
+ Map Operator Tree:
+ TableScan
+ alias: srcpart_date
+ filterExpr: ((date = '2008-04-08') and ds is not null) (type: boolean)
+ Statistics: Num rows: 2 Data size: 42 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: ((date = '2008-04-08') and ds is not null) (type: boolean)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: ds (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: day(_col0) (type: int)
+ sort order: +
+ Map-reduce partition columns: day(_col0) (type: int)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: day(_col0) (type: int)
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Group By Operator
+ keys: _col0 (type: int)
+ mode: hash
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Dynamic Partitioning Event Operator
+ Target column: ds (string)
+ Target Input: srcpart
+ Partition key expr: day(ds)
+ Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
+ Target Vertex: Map 1
+ Reducer 2
+ Reduce Operator Tree:
+ Group By Operator
+ aggregations: count(VALUE._col0)
+ mode: mergepartial
+ outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+
+ Stage: Stage-0
+ Fetch Operator
+ limit: -1
+ Processor Tree:
+ ListSink
+
+PREHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+PREHOOK: type: QUERY
+PREHOOK: Input: default@srcpart
+PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
+PREHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
+PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
+PREHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
+PREHOOK: Input: default@srcpart_date
+#### A masked pattern was here ####
+POSTHOOK: query: select count(*) from srcpart join srcpart_date on (day(srcpart.ds) = day(srcpart_date.ds)) where srcpart_date.`date` = '2008-04-08'
+POSTHOOK: type: QUERY
+POSTHOOK: Input: default@srcpart
+POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=11
+POSTHOOK: Input: default@srcpart@ds=2008-04-08/hr=12
+POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=11
+POSTHOOK: Input: default@srcpart@ds=2008-04-09/hr=12
+POSTHOOK: Input: default@srcpart_date
+#### A masked pattern was here ####
+1000
PREHOOK: query: -- multiple sources, single key
EXPLAIN select count(*) from srcpart join srcpart_date on (srcpart.ds = srcpart_date.ds) join srcpart_hour on (srcpart.hr = srcpart_hour.hr)
where srcpart_date.`date` = '2008-04-08' and srcpart_hour.hour = 11
@@ -3756,10 +4107,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Map 4
Map Operator Tree:
@@ -3789,10 +4140,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -3923,10 +4274,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: _col2 (type: string)
@@ -3938,10 +4289,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: hr
Statistics: Num rows: 1 Data size: 27 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -4069,10 +4420,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -4176,10 +4527,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: UDFToDouble(hr)
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -4294,10 +4645,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (string)
Target Input: srcpart
Partition key expr: (UDFToDouble(hr) * 2.0)
Statistics: Num rows: 1 Data size: 7 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -4557,10 +4908,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -4837,10 +5188,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 1 Data size: 21 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Map 4
Map Operator Tree:
@@ -5152,10 +5503,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Reducer 7
Reduce Operator Tree:
@@ -5187,10 +5538,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart
Partition key expr: ds
Statistics: Num rows: 2 Data size: 168 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Union 5
Vertex: Union 5
@@ -5328,10 +5679,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: srcpart_orc
Partition key expr: ds
Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Select Operator
expressions: UDFToDouble(_col2) (type: double)
@@ -5343,10 +5694,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: hr (int)
Target Input: srcpart_orc
Partition key expr: UDFToDouble(hr)
Statistics: Num rows: 2 Data size: 54 Basic stats: COMPLETE Column stats: NONE
- Target column: hr
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
http://git-wip-us.apache.org/repos/asf/hive/blob/45ae30c8/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out
----------------------------------------------------------------------
diff --git a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out
index bc5638c..0d8e2bd 100644
--- a/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out
+++ b/ql/src/test/results/clientpositive/tez/dynamic_partition_pruning_2.q.out
@@ -226,10 +226,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: dim_shops_id (int)
Target Input: agg
Partition key expr: dim_shops_id
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
- Target column: dim_shops_id
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -752,10 +752,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: dim_shops_id (int)
Target Input: agg
Partition key expr: dim_shops_id
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
- Target column: dim_shops_id
Target Vertex: Map 1
Reducer 2
Reduce Operator Tree:
@@ -900,10 +900,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: dim_shops_id (int)
Target Input: agg_01
Partition key expr: dim_shops_id
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
- Target column: dim_shops_id
Target Vertex: Map 1
Map 4
Map Operator Tree:
@@ -961,10 +961,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: dim_shops_id (int)
Target Input: agg_01
Partition key expr: dim_shops_id
Statistics: Num rows: 1 Data size: 5 Basic stats: COMPLETE Column stats: NONE
- Target column: dim_shops_id
Target Vertex: Map 4
Union 2
Vertex: Union 2
http://git-wip-us.apache.org/repos/asf/hive/blob/45ae30c8/ql/src/test/results/clientpositive/tez/metadataonly1.q.out
----------------------------------------------------------------------
diff --git a/ql/src/test/results/clientpositive/tez/metadataonly1.q.out b/ql/src/test/results/clientpositive/tez/metadataonly1.q.out
index 4ef71f8..37408e1 100644
--- a/ql/src/test/results/clientpositive/tez/metadataonly1.q.out
+++ b/ql/src/test/results/clientpositive/tez/metadataonly1.q.out
@@ -920,10 +920,10 @@ STAGE PLANS:
outputColumnNames: _col0
Statistics: Num rows: 1 Data size: 84 Basic stats: COMPLETE Column stats: NONE
Dynamic Partitioning Event Operator
+ Target column: ds (string)
Target Input: a2
Partition key expr: ds
Statistics: Num rows: 1 Data size: 84 Basic stats: COMPLETE Column stats: NONE
- Target column: ds
Target Vertex: Map 1
Stage: Stage-0