You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by gu...@apache.org on 2014/02/06 01:44:01 UTC
svn commit: r1565025 [1/7] - /hive/trunk/ql/src/test/results/clientpositive/
Author: gunther
Date: Thu Feb 6 00:43:59 2014
New Revision: 1565025
URL: http://svn.apache.org/r1565025
Log:
HIVE-6353: Update hadoop-2 golden files after HIVE-6267 (Patch by Gunther Hagleitner, reviewed by Vikram Dixit K)
Modified:
hive/trunk/ql/src/test/results/clientpositive/auto_join14.q.out
hive/trunk/ql/src/test/results/clientpositive/combine2.q.out
hive/trunk/ql/src/test/results/clientpositive/ctas.q.out
hive/trunk/ql/src/test/results/clientpositive/input12.q.out
hive/trunk/ql/src/test/results/clientpositive/input39.q.out
hive/trunk/ql/src/test/results/clientpositive/join14.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_12.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_13.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_2.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_3.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_4.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_5.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_7.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_8.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_9.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out
hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out
hive/trunk/ql/src/test/results/clientpositive/skewjoin_union_remove_1.q.out
hive/trunk/ql/src/test/results/clientpositive/skewjoin_union_remove_2.q.out
hive/trunk/ql/src/test/results/clientpositive/stats_partscan_1_23.q.out
hive/trunk/ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_1.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_10.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_11.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_12.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_13.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_14.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_15.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_16.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_17.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_18.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_19.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_2.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_20.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_21.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_22.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_23.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_24.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_3.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_4.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_5.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_7.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_8.q.out
hive/trunk/ql/src/test/results/clientpositive/union_remove_9.q.out
Modified: hive/trunk/ql/src/test/results/clientpositive/auto_join14.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/auto_join14.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/auto_join14.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/auto_join14.q.out Thu Feb 6 00:43:59 2014
@@ -15,9 +15,6 @@ POSTHOOK: query: explain
FROM src JOIN srcpart ON src.key = srcpart.key AND srcpart.ds = '2008-04-08' and src.key > 100
INSERT OVERWRITE TABLE dest1 SELECT src.key, srcpart.value
POSTHOOK: type: QUERY
-ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME src)) (TOK_TABREF (TOK_TABNAME srcpart)) (and (AND (= (. (TOK_TABLE_OR_COL src) key) (. (TOK_TABLE_OR_COL srcpart) key)) (= (. (TOK_TABLE_OR_COL srcpart) ds) '2008-04-08')) (> (. (TOK_TABLE_OR_COL src) key) 100)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME dest1))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL src) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL srcpart) value)))))
-
STAGE DEPENDENCIES:
Stage-5 is a root stage
Stage-4 depends on stages: Stage-5
@@ -35,52 +32,45 @@ STAGE PLANS:
src
TableScan
alias: src
+ Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate:
- expr: (key > 100)
- type: boolean
+ predicate: (key > 100) (type: boolean)
+ Statistics: Num rows: 19 Data size: 1903 Basic stats: COMPLETE Column stats: NONE
HashTable Sink Operator
condition expressions:
0 {key}
1 {value}
- handleSkewJoin: false
keys:
- 0 [Column[key]]
- 1 [Column[key]]
- Position of Big Table: 1
+ 0 key (type: string)
+ 1 key (type: string)
Stage: Stage-4
Map Reduce
- Alias -> Map Operator Tree:
- srcpart
+ Map Operator Tree:
TableScan
alias: srcpart
+ Statistics: Num rows: 58 Data size: 11624 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate:
- expr: (key > 100)
- type: boolean
+ predicate: (key > 100) (type: boolean)
+ Statistics: Num rows: 19 Data size: 3807 Basic stats: COMPLETE Column stats: NONE
Map Join Operator
condition map:
Inner Join 0 to 1
condition expressions:
0 {key}
1 {value}
- handleSkewJoin: false
keys:
- 0 [Column[key]]
- 1 [Column[key]]
+ 0 key (type: string)
+ 1 key (type: string)
outputColumnNames: _col0, _col5
- Position of Big Table: 1
+ Statistics: Num rows: 20 Data size: 2093 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: UDFToInteger(_col0)
- type: int
- expr: _col5
- type: string
+ expressions: UDFToInteger(_col0) (type: int), _col5 (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 20 Data size: 2093 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 1
+ Statistics: Num rows: 20 Data size: 2093 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -102,7 +92,6 @@ STAGE PLANS:
Stage: Stage-2
Stats-Aggr Operator
-
PREHOOK: query: FROM src JOIN srcpart ON src.key = srcpart.key AND srcpart.ds = '2008-04-08' and src.key > 100
INSERT OVERWRITE TABLE dest1 SELECT src.key, srcpart.value
PREHOOK: type: QUERY
Modified: hive/trunk/ql/src/test/results/clientpositive/combine2.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/combine2.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/combine2.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/combine2.q.out Thu Feb 6 00:43:59 2014
@@ -102,9 +102,6 @@ POSTHOOK: Lineage: combine2 PARTITION(va
POSTHOOK: Lineage: combine2 PARTITION(value=val_8).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: combine2 PARTITION(value=val_9).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: combine2 PARTITION(value=|).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
-ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME combine2))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value))) (TOK_WHERE (TOK_FUNCTION TOK_ISNOTNULL (TOK_TABLE_OR_COL value))) (TOK_ORDERBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key)))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-0 is a root stage
@@ -112,33 +109,25 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- combine2
+ Map Operator Tree:
TableScan
alias: combine2
+ Statistics: Num rows: 12 Data size: 14 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 12 Data size: 14 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
+ key expressions: _col0 (type: string)
sort order: +
- tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ Statistics: Num rows: 12 Data size: 14 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: string), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 12 Data size: 14 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 0
+ Statistics: Num rows: 12 Data size: 14 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -207,7 +196,27 @@ POSTHOOK: Lineage: combine2 PARTITION(va
POSTHOOK: Lineage: combine2 PARTITION(value=val_9).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: combine2 PARTITION(value=|).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME combine2))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION count 1))) (TOK_WHERE (TOK_FUNCTION TOK_ISNOTNULL (TOK_TABLE_OR_COL value)))))
+
+TOK_QUERY
+ TOK_FROM
+ TOK_TABREF
+ TOK_TABNAME
+ combine2
+ TOK_INSERT
+ TOK_DESTINATION
+ TOK_DIR
+ TOK_TMP_FILE
+ TOK_SELECT
+ TOK_SELEXPR
+ TOK_FUNCTION
+ count
+ 1
+ TOK_WHERE
+ TOK_FUNCTION
+ TOK_ISNOTNULL
+ TOK_TABLE_OR_COL
+ value
+
STAGE DEPENDENCIES:
Stage-1 is a root stage
@@ -216,32 +225,23 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- combine2
+ Map Operator Tree:
TableScan
alias: combine2
- Statistics:
- numRows: 12 dataSize: 14 basicStatsState: COMPLETE colStatsState: COMPLETE
+ Statistics: Num rows: 12 Data size: 14 Basic stats: COMPLETE Column stats: COMPLETE
GatherStats: false
Select Operator
- Statistics:
- numRows: 12 dataSize: 14 basicStatsState: COMPLETE colStatsState: COMPLETE
+ Statistics: Num rows: 12 Data size: 14 Basic stats: COMPLETE Column stats: COMPLETE
Group By Operator
- aggregations:
- expr: count(1)
- bucketGroup: false
+ aggregations: count(1)
mode: hash
outputColumnNames: _col0
- Statistics:
- numRows: 1 dataSize: 8 basicStatsState: COMPLETE colStatsState: COMPLETE
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE
Reduce Output Operator
sort order:
- Statistics:
- numRows: 1 dataSize: 8 basicStatsState: COMPLETE colStatsState: COMPLETE
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE
tag: -1
- value expressions:
- expr: _col0
- type: bigint
+ value expressions: _col0 (type: bigint)
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -585,27 +585,20 @@ STAGE PLANS:
Needs Tagging: false
Reduce Operator Tree:
Group By Operator
- aggregations:
- expr: count(VALUE._col0)
- bucketGroup: false
+ aggregations: count(VALUE._col0)
mode: mergepartial
outputColumnNames: _col0
- Statistics:
- numRows: 1 dataSize: 8 basicStatsState: COMPLETE colStatsState: COMPLETE
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE
Select Operator
- expressions:
- expr: _col0
- type: bigint
+ expressions: _col0 (type: bigint)
outputColumnNames: _col0
- Statistics:
- numRows: 1 dataSize: 8 basicStatsState: COMPLETE colStatsState: COMPLETE
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE
File Output Operator
compressed: false
GlobalTableId: 0
#### A masked pattern was here ####
NumFilesPerFileSink: 1
- Statistics:
- numRows: 1 dataSize: 8 basicStatsState: COMPLETE colStatsState: COMPLETE
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: COMPLETE
#### A masked pattern was here ####
table:
input format: org.apache.hadoop.mapred.TextInputFormat
@@ -673,9 +666,6 @@ POSTHOOK: Lineage: combine2 PARTITION(va
POSTHOOK: Lineage: combine2 PARTITION(value=val_8).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: combine2 PARTITION(value=val_9).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: combine2 PARTITION(value=|).key EXPRESSION [(src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), (src)src.FieldSchema(name:key, type:string, comment:default), ]
-ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME srcpart))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL ds)) (TOK_SELEXPR (TOK_FUNCTION count 1))) (TOK_WHERE (TOK_FUNCTION TOK_ISNOTNULL (TOK_TABLE_OR_COL ds))) (TOK_GROUPBY (TOK_TABLE_OR_COL ds))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-0 is a root stage
@@ -683,56 +673,40 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- srcpart
+ Map Operator Tree:
TableScan
alias: srcpart
+ Statistics: Num rows: 0 Data size: 23248 Basic stats: PARTIAL Column stats: COMPLETE
Select Operator
- expressions:
- expr: ds
- type: string
+ expressions: ds (type: string)
outputColumnNames: ds
+ Statistics: Num rows: 0 Data size: 23248 Basic stats: PARTIAL Column stats: COMPLETE
Group By Operator
- aggregations:
- expr: count(1)
- bucketGroup: false
- keys:
- expr: ds
- type: string
+ aggregations: count(1)
+ keys: ds (type: string)
mode: hash
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 0 Data size: 23248 Basic stats: PARTIAL Column stats: COMPLETE
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
+ key expressions: _col0 (type: string)
sort order: +
- Map-reduce partition columns:
- expr: _col0
- type: string
- tag: -1
- value expressions:
- expr: _col1
- type: bigint
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 0 Data size: 23248 Basic stats: PARTIAL Column stats: COMPLETE
+ value expressions: _col1 (type: bigint)
Reduce Operator Tree:
Group By Operator
- aggregations:
- expr: count(VALUE._col0)
- bucketGroup: false
- keys:
- expr: KEY._col0
- type: string
+ aggregations: count(VALUE._col0)
+ keys: KEY._col0 (type: string)
mode: mergepartial
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: COMPLETE
Select Operator
- expressions:
- expr: _col0
- type: string
- expr: _col1
- type: bigint
+ expressions: _col0 (type: string), _col1 (type: bigint)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: COMPLETE
File Output Operator
compressed: false
- GlobalTableId: 0
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: COMPLETE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
Modified: hive/trunk/ql/src/test/results/clientpositive/ctas.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/ctas.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/ctas.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/ctas.q.out Thu Feb 6 00:43:59 2014
@@ -19,9 +19,6 @@ PREHOOK: query: explain create table nzh
PREHOOK: type: CREATETABLE_AS_SELECT
POSTHOOK: query: explain create table nzhang_CTAS1 as select key k, value from src sort by k, value limit 10
POSTHOOK: type: CREATETABLE_AS_SELECT
-ABSTRACT SYNTAX TREE:
- (TOK_CREATETABLE (TOK_TABNAME nzhang_CTAS1) TOK_LIKETABLE (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key) k) (TOK_SELEXPR (TOK_TABLE_OR_COL value))) (TOK_SORTBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL k)) (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL value))) (TOK_LIMIT 10))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-2 depends on stages: Stage-1
@@ -32,36 +29,27 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
alias: src
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: string), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.SequenceFileInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
@@ -69,28 +57,22 @@ STAGE PLANS:
Stage: Stage-2
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: string), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 1
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -107,12 +89,9 @@ STAGE PLANS:
Create Table Operator:
Create Table
columns: k string, value string
- if not exists: false
input format: org.apache.hadoop.mapred.TextInputFormat
- # buckets: -1
output format: org.apache.hadoop.hive.ql.io.IgnoreKeyTextOutputFormat
name: nzhang_CTAS1
- isExternal: false
Stage: Stage-3
Stats-Aggr Operator
@@ -180,9 +159,6 @@ PREHOOK: query: explain create table nzh
PREHOOK: type: CREATETABLE_AS_SELECT
POSTHOOK: query: explain create table nzhang_ctas2 as select * from src sort by key, value limit 10
POSTHOOK: type: CREATETABLE_AS_SELECT
-ABSTRACT SYNTAX TREE:
- (TOK_CREATETABLE (TOK_TABNAME nzhang_ctas2) TOK_LIKETABLE (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR TOK_ALLCOLREF)) (TOK_SORTBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key)) (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL value))) (TOK_LIMIT 10))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-2 depends on stages: Stage-1
@@ -193,36 +169,27 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
alias: src
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: string), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.SequenceFileInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
@@ -230,28 +197,22 @@ STAGE PLANS:
Stage: Stage-2
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: string), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 1
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -268,12 +229,9 @@ STAGE PLANS:
Create Table Operator:
Create Table
columns: key string, value string
- if not exists: false
input format: org.apache.hadoop.mapred.TextInputFormat
- # buckets: -1
output format: org.apache.hadoop.hive.ql.io.IgnoreKeyTextOutputFormat
name: nzhang_ctas2
- isExternal: false
Stage: Stage-3
Stats-Aggr Operator
@@ -341,9 +299,6 @@ PREHOOK: query: explain create table nzh
PREHOOK: type: CREATETABLE_AS_SELECT
POSTHOOK: query: explain create table nzhang_ctas3 row format serde "org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe" stored as RCFile as select key/2 half_key, concat(value, "_con") conb from src sort by half_key, conb limit 10
POSTHOOK: type: CREATETABLE_AS_SELECT
-ABSTRACT SYNTAX TREE:
- (TOK_CREATETABLE (TOK_TABNAME nzhang_ctas3) TOK_LIKETABLE (TOK_TABLESERIALIZER (TOK_SERDENAME "org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe")) TOK_TBLRCFILE (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (/ (TOK_TABLE_OR_COL key) 2) half_key) (TOK_SELEXPR (TOK_FUNCTION concat (TOK_TABLE_OR_COL value) "_con") conb)) (TOK_SORTBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL half_key)) (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL conb))) (TOK_LIMIT 10))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-2 depends on stages: Stage-1
@@ -354,36 +309,27 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
alias: src
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: (key / 2)
- type: double
- expr: concat(value, '_con')
- type: string
+ expressions: (key / 2) (type: double), concat(value, '_con') (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: _col0
- type: double
- expr: _col1
- type: string
+ key expressions: _col0 (type: double), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: double
- expr: _col1
- type: string
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: double), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.SequenceFileInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
@@ -391,28 +337,22 @@ STAGE PLANS:
Stage: Stage-2
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
Reduce Output Operator
- key expressions:
- expr: _col0
- type: double
- expr: _col1
- type: string
+ key expressions: _col0 (type: double), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: double
- expr: _col1
- type: string
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: double), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 1
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.hive.ql.io.RCFileInputFormat
output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat
@@ -429,13 +369,10 @@ STAGE PLANS:
Create Table Operator:
Create Table
columns: half_key double, conb string
- if not exists: false
input format: org.apache.hadoop.hive.ql.io.RCFileInputFormat
- # buckets: -1
output format: org.apache.hadoop.hive.ql.io.RCFileOutputFormat
serde name: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe
name: nzhang_ctas3
- isExternal: false
Stage: Stage-3
Stats-Aggr Operator
@@ -503,9 +440,6 @@ PREHOOK: query: explain create table if
PREHOOK: type: CREATETABLE
POSTHOOK: query: explain create table if not exists nzhang_ctas3 as select key, value from src sort by key, value limit 2
POSTHOOK: type: CREATETABLE
-ABSTRACT SYNTAX TREE:
- (TOK_CREATETABLE (TOK_TABNAME nzhang_ctas3) TOK_IFNOTEXISTS TOK_LIKETABLE (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value))) (TOK_SORTBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key)) (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL value))) (TOK_LIMIT 2))))
-
STAGE DEPENDENCIES:
STAGE PLANS:
@@ -569,9 +503,6 @@ PREHOOK: query: explain create table nzh
PREHOOK: type: CREATETABLE_AS_SELECT
POSTHOOK: query: explain create table nzhang_ctas4 row format delimited fields terminated by ',' stored as textfile as select key, value from src sort by key, value limit 10
POSTHOOK: type: CREATETABLE_AS_SELECT
-ABSTRACT SYNTAX TREE:
- (TOK_CREATETABLE (TOK_TABNAME nzhang_ctas4) TOK_LIKETABLE (TOK_TABLEROWFORMAT (TOK_SERDEPROPS (TOK_TABLEROWFORMATFIELD ','))) TOK_TBLTEXTFILE (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value))) (TOK_SORTBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key)) (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL value))) (TOK_LIMIT 10))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-2 depends on stages: Stage-1
@@ -582,36 +513,27 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
alias: src
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: string), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.SequenceFileInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
@@ -619,28 +541,22 @@ STAGE PLANS:
Stage: Stage-2
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: string), _col1 (type: string)
Reduce Operator Tree:
Extract
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
Limit
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 1
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -658,12 +574,9 @@ STAGE PLANS:
Create Table
columns: key string, value string
field delimiter: ,
- if not exists: false
input format: org.apache.hadoop.mapred.TextInputFormat
- # buckets: -1
output format: org.apache.hadoop.hive.ql.io.IgnoreKeyTextOutputFormat
name: nzhang_ctas4
- isExternal: false
Stage: Stage-3
Stats-Aggr Operator
@@ -733,7 +646,44 @@ PREHOOK: type: CREATETABLE_AS_SELECT
POSTHOOK: query: explain extended create table nzhang_ctas5 row format delimited fields terminated by ',' lines terminated by '\012' stored as textfile as select key, value from src sort by key, value limit 10
POSTHOOK: type: CREATETABLE_AS_SELECT
ABSTRACT SYNTAX TREE:
- (TOK_CREATETABLE (TOK_TABNAME nzhang_ctas5) TOK_LIKETABLE (TOK_TABLEROWFORMAT (TOK_SERDEPROPS (TOK_TABLEROWFORMATFIELD ',') (TOK_TABLEROWFORMATLINES '\012'))) TOK_TBLTEXTFILE (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value))) (TOK_SORTBY (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL key)) (TOK_TABSORTCOLNAMEASC (TOK_TABLE_OR_COL value))) (TOK_LIMIT 10))))
+
+TOK_CREATETABLE
+ TOK_TABNAME
+ nzhang_ctas5
+ TOK_LIKETABLE
+ TOK_TABLEROWFORMAT
+ TOK_SERDEPROPS
+ TOK_TABLEROWFORMATFIELD
+ ','
+ TOK_TABLEROWFORMATLINES
+ '\012'
+ TOK_TBLTEXTFILE
+ TOK_QUERY
+ TOK_FROM
+ TOK_TABREF
+ TOK_TABNAME
+ src
+ TOK_INSERT
+ TOK_DESTINATION
+ TOK_DIR
+ TOK_TMP_FILE
+ TOK_SELECT
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ key
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ value
+ TOK_SORTBY
+ TOK_TABSORTCOLNAMEASC
+ TOK_TABLE_OR_COL
+ key
+ TOK_TABSORTCOLNAMEASC
+ TOK_TABLE_OR_COL
+ value
+ TOK_LIMIT
+ 10
+
STAGE DEPENDENCIES:
Stage-1 is a root stage
@@ -745,37 +695,21 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
alias: src
- Statistics:
- numRows: 29 dataSize: 5812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
GatherStats: false
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
- Statistics:
- numRows: 29 dataSize: 5812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- Statistics:
- numRows: 29 dataSize: 5812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ value expressions: _col0 (type: string), _col1 (type: string)
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -826,11 +760,10 @@ STAGE PLANS:
Needs Tagging: false
Reduce Operator Tree:
Extract
- Statistics:
- numRows: 29 dataSize: 5812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Limit
- Statistics:
- numRows: 10 dataSize: 2000 basicStatsState: COMPLETE colStatsState: NONE
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
GlobalTableId: 0
@@ -851,25 +784,15 @@ STAGE PLANS:
Stage: Stage-2
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
GatherStats: false
Reduce Output Operator
- key expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ key expressions: _col0 (type: string), _col1 (type: string)
sort order: ++
- Statistics:
- numRows: 10 dataSize: 2000 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
tag: -1
- value expressions:
- expr: _col0
- type: string
- expr: _col1
- type: string
+ value expressions: _col0 (type: string), _col1 (type: string)
Path -> Alias:
#### A masked pattern was here ####
Path -> Partition:
@@ -898,18 +821,16 @@ STAGE PLANS:
Needs Tagging: false
Reduce Operator Tree:
Extract
- Statistics:
- numRows: 10 dataSize: 2000 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
Limit
- Statistics:
- numRows: 10 dataSize: 2000 basicStatsState: COMPLETE colStatsState: NONE
+ Number of rows: 10
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
GlobalTableId: 1
#### A masked pattern was here ####
NumFilesPerFileSink: 1
- Statistics:
- numRows: 10 dataSize: 2000 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 10 Data size: 2000 Basic stats: COMPLETE Column stats: NONE
#### A masked pattern was here ####
table:
input format: org.apache.hadoop.mapred.TextInputFormat
@@ -940,14 +861,11 @@ STAGE PLANS:
Create Table
columns: key string, value string
field delimiter: ,
- if not exists: false
input format: org.apache.hadoop.mapred.TextInputFormat
line delimiter:
- # buckets: -1
output format: org.apache.hadoop.hive.ql.io.IgnoreKeyTextOutputFormat
name: nzhang_ctas5
- isExternal: false
Stage: Stage-3
Stats-Aggr Operator
Modified: hive/trunk/ql/src/test/results/clientpositive/input12.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/input12.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/input12.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/input12.q.out Thu Feb 6 00:43:59 2014
@@ -29,9 +29,6 @@ INSERT OVERWRITE TABLE dest1 SELECT src.
INSERT OVERWRITE TABLE dest2 SELECT src.key, src.value WHERE src.key >= 100 and src.key < 200
INSERT OVERWRITE TABLE dest3 PARTITION(ds='2008-04-08', hr='12') SELECT src.key WHERE src.key >= 200
POSTHOOK: type: QUERY
-ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME dest1))) (TOK_SELECT (TOK_SELEXPR (TOK_ALLCOLREF (TOK_TABNAME src)))) (TOK_WHERE (< (. (TOK_TABLE_OR_COL src) key) 100))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME dest2))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL src) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL src) value))) (TOK_WHERE (and (>= (. (TOK_TABLE_OR_COL src) key) 100) (< (. (TOK_TABLE_OR_COL src) key) 200)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME dest3) (TOK_PARTSPEC (TOK_PARTVAL ds '2008-04-08') (TOK_PARTVAL hr '12')))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL src) key))) (TOK_WHERE (>= (. (TOK_TABLE_OR_COL src) key) 200))))
-
STAGE DEPENDENCIES:
Stage-3 is a root stage
Stage-9 depends on stages: Stage-3 , consists of Stage-6, Stage-5, Stage-7
@@ -59,60 +56,50 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-3
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
alias: src
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate:
- expr: (key < 100)
- type: boolean
+ predicate: (key < 100) (type: boolean)
+ Statistics: Num rows: 9 Data size: 1803 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: UDFToInteger(key)
- type: int
- expr: value
- type: string
+ expressions: UDFToInteger(key) (type: int), value (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 9 Data size: 1803 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 1
+ Statistics: Num rows: 9 Data size: 1803 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
name: default.dest1
Filter Operator
- predicate:
- expr: ((key >= 100) and (key < 200))
- type: boolean
+ predicate: ((key >= 100) and (key < 200)) (type: boolean)
+ Statistics: Num rows: 3 Data size: 601 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: UDFToInteger(key)
- type: int
- expr: value
- type: string
+ expressions: UDFToInteger(key) (type: int), value (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 3 Data size: 601 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 2
+ Statistics: Num rows: 3 Data size: 601 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
name: default.dest2
Filter Operator
- predicate:
- expr: (key >= 200)
- type: boolean
+ predicate: (key >= 200) (type: boolean)
+ Statistics: Num rows: 9 Data size: 1803 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: UDFToInteger(key)
- type: int
+ expressions: UDFToInteger(key) (type: int)
outputColumnNames: _col0
+ Statistics: Num rows: 9 Data size: 1803 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 3
+ Statistics: Num rows: 9 Data size: 1803 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -143,12 +130,10 @@ STAGE PLANS:
Stage: Stage-5
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -157,12 +142,10 @@ STAGE PLANS:
Stage: Stage-7
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -199,12 +182,10 @@ STAGE PLANS:
Stage: Stage-11
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -213,12 +194,10 @@ STAGE PLANS:
Stage: Stage-13
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -258,12 +237,10 @@ STAGE PLANS:
Stage: Stage-17
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -272,12 +249,10 @@ STAGE PLANS:
Stage: Stage-19
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -290,7 +265,6 @@ STAGE PLANS:
hdfs directory: true
#### A masked pattern was here ####
-
PREHOOK: query: FROM src
INSERT OVERWRITE TABLE dest1 SELECT src.* WHERE src.key < 100
INSERT OVERWRITE TABLE dest2 SELECT src.key, src.value WHERE src.key >= 100 and src.key < 200
Modified: hive/trunk/ql/src/test/results/clientpositive/input39.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/input39.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/input39.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/input39.q.out Thu Feb 6 00:43:59 2014
@@ -68,9 +68,6 @@ POSTHOOK: Lineage: t1 PARTITION(ds=2).ke
POSTHOOK: Lineage: t1 PARTITION(ds=2).value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
POSTHOOK: Lineage: t2 PARTITION(ds=1).key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: t2 PARTITION(ds=1).value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
-ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME t1)) (TOK_TABREF (TOK_TABNAME t2)) (= (. (TOK_TABLE_OR_COL t1) key) (. (TOK_TABLE_OR_COL t2) key)))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_FUNCTION count 1))) (TOK_WHERE (and (= (. (TOK_TABLE_OR_COL t1) ds) '1') (= (. (TOK_TABLE_OR_COL t2) ds) '1')))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-2 depends on stages: Stage-1
@@ -79,39 +76,29 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- t1
+ Map Operator Tree:
TableScan
- alias: t1
+ alias: t2
+ Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate:
- expr: (((hash(rand(460476415)) & 2147483647) % 32) = 0)
- type: boolean
+ predicate: (((hash(rand(460476415)) & 2147483647) % 32) = 0) (type: boolean)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: key
- type: string
+ key expressions: key (type: string)
sort order: +
- Map-reduce partition columns:
- expr: key
- type: string
- tag: 0
- t2
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
TableScan
- alias: t2
+ alias: t1
+ Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate:
- expr: (((hash(rand(460476415)) & 2147483647) % 32) = 0)
- type: boolean
+ predicate: (((hash(rand(460476415)) & 2147483647) % 32) = 0) (type: boolean)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: key
- type: string
+ key expressions: key (type: string)
sort order: +
- Map-reduce partition columns:
- expr: key
- type: string
- tag: 1
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
Reduce Operator Tree:
Join Operator
condition map:
@@ -119,17 +106,16 @@ STAGE PLANS:
condition expressions:
0
1
- handleSkewJoin: false
+ Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
Select Operator
+ Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
Group By Operator
- aggregations:
- expr: count(1)
- bucketGroup: false
+ aggregations: count(1)
mode: hash
outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 0
table:
input format: org.apache.hadoop.mapred.SequenceFileInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat
@@ -137,30 +123,25 @@ STAGE PLANS:
Stage: Stage-2
Map Reduce
- Alias -> Map Operator Tree:
-#### A masked pattern was here ####
+ Map Operator Tree:
TableScan
Reduce Output Operator
sort order:
- tag: -1
- value expressions:
- expr: _col0
- type: bigint
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col0 (type: bigint)
Reduce Operator Tree:
Group By Operator
- aggregations:
- expr: count(VALUE._col0)
- bucketGroup: false
+ aggregations: count(VALUE._col0)
mode: mergepartial
outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: _col0
- type: bigint
+ expressions: _col0 (type: bigint)
outputColumnNames: _col0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 0
+ Statistics: Num rows: 1 Data size: 8 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -170,7 +151,6 @@ STAGE PLANS:
Fetch Operator
limit: -1
-
PREHOOK: query: select count(1) from t1 join t2 on t1.key=t2.key where t1.ds='1' and t2.ds='1'
PREHOOK: type: QUERY
PREHOOK: Input: default@t1
Modified: hive/trunk/ql/src/test/results/clientpositive/join14.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/join14.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/join14.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/join14.q.out Thu Feb 6 00:43:59 2014
@@ -15,9 +15,6 @@ POSTHOOK: query: EXPLAIN
FROM src JOIN srcpart ON src.key = srcpart.key AND srcpart.ds = '2008-04-08' and src.key > 100
INSERT OVERWRITE TABLE dest1 SELECT src.key, srcpart.value
POSTHOOK: type: QUERY
-ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_JOIN (TOK_TABREF (TOK_TABNAME src)) (TOK_TABREF (TOK_TABNAME srcpart)) (and (AND (= (. (TOK_TABLE_OR_COL src) key) (. (TOK_TABLE_OR_COL srcpart) key)) (= (. (TOK_TABLE_OR_COL srcpart) ds) '2008-04-08')) (> (. (TOK_TABLE_OR_COL src) key) 100)))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME dest1))) (TOK_SELECT (TOK_SELEXPR (. (TOK_TABLE_OR_COL src) key)) (TOK_SELEXPR (. (TOK_TABLE_OR_COL srcpart) value)))))
-
STAGE DEPENDENCIES:
Stage-1 is a root stage
Stage-0 depends on stages: Stage-1
@@ -26,45 +23,31 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
- alias: src
+ alias: srcpart
+ Statistics: Num rows: 58 Data size: 11624 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate:
- expr: (key > 100)
- type: boolean
+ predicate: (key > 100) (type: boolean)
+ Statistics: Num rows: 19 Data size: 3807 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: key
- type: string
+ key expressions: key (type: string)
sort order: +
- Map-reduce partition columns:
- expr: key
- type: string
- tag: 0
- value expressions:
- expr: key
- type: string
- srcpart
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 19 Data size: 3807 Basic stats: COMPLETE Column stats: NONE
+ value expressions: value (type: string)
TableScan
- alias: srcpart
+ alias: src
+ Statistics: Num rows: 58 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate:
- expr: (key > 100)
- type: boolean
+ predicate: (key > 100) (type: boolean)
+ Statistics: Num rows: 19 Data size: 1903 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
- key expressions:
- expr: key
- type: string
+ key expressions: key (type: string)
sort order: +
- Map-reduce partition columns:
- expr: key
- type: string
- tag: 1
- value expressions:
- expr: value
- type: string
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 19 Data size: 1903 Basic stats: COMPLETE Column stats: NONE
+ value expressions: key (type: string)
Reduce Operator Tree:
Join Operator
condition map:
@@ -72,18 +55,15 @@ STAGE PLANS:
condition expressions:
0 {VALUE._col0}
1 {VALUE._col1}
- handleSkewJoin: false
outputColumnNames: _col0, _col5
+ Statistics: Num rows: 20 Data size: 2093 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: UDFToInteger(_col0)
- type: int
- expr: _col5
- type: string
+ expressions: UDFToInteger(_col0) (type: int), _col5 (type: string)
outputColumnNames: _col0, _col1
+ Statistics: Num rows: 20 Data size: 2093 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
- GlobalTableId: 1
+ Statistics: Num rows: 20 Data size: 2093 Basic stats: COMPLETE Column stats: NONE
table:
input format: org.apache.hadoop.mapred.TextInputFormat
output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
@@ -103,7 +83,6 @@ STAGE PLANS:
Stage: Stage-2
Stats-Aggr Operator
-
PREHOOK: query: FROM src JOIN srcpart ON src.key = srcpart.key AND srcpart.ds = '2008-04-08' and src.key > 100
INSERT OVERWRITE TABLE dest1 SELECT src.key, srcpart.value
PREHOOK: type: QUERY
Modified: hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out Thu Feb 6 00:43:59 2014
@@ -28,7 +28,39 @@ explain extended
insert overwrite table list_bucketing_dynamic_part partition (ds='2008-04-08', hr) select key, value, hr from srcpart where ds='2008-04-08'
POSTHOOK: type: QUERY
ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME srcpart))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME list_bucketing_dynamic_part) (TOK_PARTSPEC (TOK_PARTVAL ds '2008-04-08') (TOK_PARTVAL hr)))) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value)) (TOK_SELEXPR (TOK_TABLE_OR_COL hr))) (TOK_WHERE (= (TOK_TABLE_OR_COL ds) '2008-04-08'))))
+
+TOK_QUERY
+ TOK_FROM
+ TOK_TABREF
+ TOK_TABNAME
+ srcpart
+ TOK_INSERT
+ TOK_DESTINATION
+ TOK_TAB
+ TOK_TABNAME
+ list_bucketing_dynamic_part
+ TOK_PARTSPEC
+ TOK_PARTVAL
+ ds
+ '2008-04-08'
+ TOK_PARTVAL
+ hr
+ TOK_SELECT
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ key
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ value
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ hr
+ TOK_WHERE
+ =
+ TOK_TABLE_OR_COL
+ ds
+ '2008-04-08'
+
STAGE DEPENDENCIES:
Stage-1 is a root stage
@@ -38,32 +70,22 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- srcpart
+ Map Operator Tree:
TableScan
alias: srcpart
- Statistics:
- numRows: 58 dataSize: 11624 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 58 Data size: 11624 Basic stats: COMPLETE Column stats: NONE
GatherStats: false
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
- expr: hr
- type: string
+ expressions: key (type: string), value (type: string), hr (type: string)
outputColumnNames: _col0, _col1, _col2
- Statistics:
- numRows: 58 dataSize: 11624 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 58 Data size: 11624 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
GlobalTableId: 1
#### A masked pattern was here ####
NumFilesPerFileSink: 1
Static Partition Specification: ds=2008-04-08/
- Statistics:
- numRows: 58 dataSize: 11624 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 58 Data size: 11624 Basic stats: COMPLETE Column stats: NONE
#### A masked pattern was here ####
table:
input format: org.apache.hadoop.mapred.TextInputFormat
@@ -199,7 +221,6 @@ STAGE PLANS:
#### A masked pattern was here ####
serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
name: default.list_bucketing_dynamic_part
-#### A masked pattern was here ####
Stage: Stage-2
Stats-Aggr Operator
@@ -382,7 +403,39 @@ POSTHOOK: Lineage: list_bucketing_dynami
POSTHOOK: Lineage: list_bucketing_dynamic_part PARTITION(ds=2008-04-08,hr=12).key SIMPLE [(srcpart)srcpart.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: list_bucketing_dynamic_part PARTITION(ds=2008-04-08,hr=12).value SIMPLE [(srcpart)srcpart.FieldSchema(name:value, type:string, comment:default), ]
ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME list_bucketing_dynamic_part))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value))) (TOK_WHERE (and (and (= (TOK_TABLE_OR_COL ds) '2008-04-08') (= (TOK_TABLE_OR_COL hr) '11')) (= (TOK_TABLE_OR_COL key) "484")))))
+
+TOK_QUERY
+ TOK_FROM
+ TOK_TABREF
+ TOK_TABNAME
+ list_bucketing_dynamic_part
+ TOK_INSERT
+ TOK_DESTINATION
+ TOK_DIR
+ TOK_TMP_FILE
+ TOK_SELECT
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ key
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ value
+ TOK_WHERE
+ and
+ and
+ =
+ TOK_TABLE_OR_COL
+ ds
+ '2008-04-08'
+ =
+ TOK_TABLE_OR_COL
+ hr
+ '11'
+ =
+ TOK_TABLE_OR_COL
+ key
+ "484"
+
STAGE DEPENDENCIES:
Stage-1 is a root stage
@@ -391,36 +444,25 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- list_bucketing_dynamic_part
+ Map Operator Tree:
TableScan
alias: list_bucketing_dynamic_part
- Statistics:
- numRows: 500 dataSize: 5312 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
GatherStats: false
Filter Operator
isSamplingPred: false
- predicate:
- expr: (key = '484')
- type: boolean
- Statistics:
- numRows: 250 dataSize: 2656 basicStatsState: COMPLETE colStatsState: NONE
+ predicate: (key = '484') (type: boolean)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
- Statistics:
- numRows: 250 dataSize: 2656 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
GlobalTableId: 0
#### A masked pattern was here ####
NumFilesPerFileSink: 1
- Statistics:
- numRows: 250 dataSize: 2656 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
#### A masked pattern was here ####
table:
input format: org.apache.hadoop.mapred.TextInputFormat
Modified: hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out
URL: http://svn.apache.org/viewvc/hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out?rev=1565025&r1=1565024&r2=1565025&view=diff
==============================================================================
--- hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out (original)
+++ hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out Thu Feb 6 00:43:59 2014
@@ -36,7 +36,32 @@ insert overwrite table list_bucketing_st
select key, value from src
POSTHOOK: type: QUERY
ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME src))) (TOK_INSERT (TOK_DESTINATION (TOK_TAB (TOK_TABNAME list_bucketing_static_part) (TOK_PARTSPEC (TOK_PARTVAL ds '2008-04-08') (TOK_PARTVAL hr '11')))) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value)))))
+
+TOK_QUERY
+ TOK_FROM
+ TOK_TABREF
+ TOK_TABNAME
+ src
+ TOK_INSERT
+ TOK_DESTINATION
+ TOK_TAB
+ TOK_TABNAME
+ list_bucketing_static_part
+ TOK_PARTSPEC
+ TOK_PARTVAL
+ ds
+ '2008-04-08'
+ TOK_PARTVAL
+ hr
+ '11'
+ TOK_SELECT
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ key
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ value
+
STAGE DEPENDENCIES:
Stage-1 is a root stage
@@ -46,30 +71,22 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- src
+ Map Operator Tree:
TableScan
alias: src
- Statistics:
- numRows: 29 dataSize: 5812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
GatherStats: false
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
- Statistics:
- numRows: 29 dataSize: 5812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
GlobalTableId: 1
#### A masked pattern was here ####
NumFilesPerFileSink: 1
Static Partition Specification: ds=2008-04-08/hr=11/
- Statistics:
- numRows: 29 dataSize: 5812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 29 Data size: 5812 Basic stats: COMPLETE Column stats: NONE
#### A masked pattern was here ####
table:
input format: org.apache.hadoop.hive.ql.io.RCFileInputFormat
@@ -162,7 +179,6 @@ STAGE PLANS:
#### A masked pattern was here ####
serde: org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe
name: default.list_bucketing_static_part
-#### A masked pattern was here ####
Stage: Stage-2
Stats-Aggr Operator
@@ -245,7 +261,39 @@ POSTHOOK: type: QUERY
POSTHOOK: Lineage: list_bucketing_static_part PARTITION(ds=2008-04-08,hr=11).key SIMPLE [(src)src.FieldSchema(name:key, type:string, comment:default), ]
POSTHOOK: Lineage: list_bucketing_static_part PARTITION(ds=2008-04-08,hr=11).value SIMPLE [(src)src.FieldSchema(name:value, type:string, comment:default), ]
ABSTRACT SYNTAX TREE:
- (TOK_QUERY (TOK_FROM (TOK_TABREF (TOK_TABNAME list_bucketing_static_part))) (TOK_INSERT (TOK_DESTINATION (TOK_DIR TOK_TMP_FILE)) (TOK_SELECT (TOK_SELEXPR (TOK_TABLE_OR_COL key)) (TOK_SELEXPR (TOK_TABLE_OR_COL value))) (TOK_WHERE (and (and (= (TOK_TABLE_OR_COL ds) '2008-04-08') (= (TOK_TABLE_OR_COL hr) '11')) (= (TOK_TABLE_OR_COL value) "val_466")))))
+
+TOK_QUERY
+ TOK_FROM
+ TOK_TABREF
+ TOK_TABNAME
+ list_bucketing_static_part
+ TOK_INSERT
+ TOK_DESTINATION
+ TOK_DIR
+ TOK_TMP_FILE
+ TOK_SELECT
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ key
+ TOK_SELEXPR
+ TOK_TABLE_OR_COL
+ value
+ TOK_WHERE
+ and
+ and
+ =
+ TOK_TABLE_OR_COL
+ ds
+ '2008-04-08'
+ =
+ TOK_TABLE_OR_COL
+ hr
+ '11'
+ =
+ TOK_TABLE_OR_COL
+ value
+ "val_466"
+
STAGE DEPENDENCIES:
Stage-1 is a root stage
@@ -254,36 +302,25 @@ STAGE DEPENDENCIES:
STAGE PLANS:
Stage: Stage-1
Map Reduce
- Alias -> Map Operator Tree:
- list_bucketing_static_part
+ Map Operator Tree:
TableScan
alias: list_bucketing_static_part
- Statistics:
- numRows: 500 dataSize: 4812 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 500 Data size: 4812 Basic stats: COMPLETE Column stats: NONE
GatherStats: false
Filter Operator
isSamplingPred: false
- predicate:
- expr: (value = 'val_466')
- type: boolean
- Statistics:
- numRows: 250 dataSize: 2406 basicStatsState: COMPLETE colStatsState: NONE
+ predicate: (value = 'val_466') (type: boolean)
+ Statistics: Num rows: 250 Data size: 2406 Basic stats: COMPLETE Column stats: NONE
Select Operator
- expressions:
- expr: key
- type: string
- expr: value
- type: string
+ expressions: key (type: string), value (type: string)
outputColumnNames: _col0, _col1
- Statistics:
- numRows: 250 dataSize: 2406 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 250 Data size: 2406 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
GlobalTableId: 0
#### A masked pattern was here ####
NumFilesPerFileSink: 1
- Statistics:
- numRows: 250 dataSize: 2406 basicStatsState: COMPLETE colStatsState: NONE
+ Statistics: Num rows: 250 Data size: 2406 Basic stats: COMPLETE Column stats: NONE
#### A masked pattern was here ####
table:
input format: org.apache.hadoop.mapred.TextInputFormat