You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by sz...@apache.org on 2014/12/05 07:57:49 UTC
svn commit: r1643162 - in /hive/branches/spark:
itests/src/test/resources/testconfiguration.properties
ql/src/test/results/clientpositive/spark/ppd_join4.q.out
Author: szehon
Date: Fri Dec 5 06:57:48 2014
New Revision: 1643162
URL: http://svn.apache.org/viewvc?rev=1643162&view=rev
Log:
HIVE-9027 : Enable ppd_join4 [Spark Branch] (Chao Sun via Szehon)
Modified:
hive/branches/spark/itests/src/test/resources/testconfiguration.properties
hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_join4.q.out
Modified: hive/branches/spark/itests/src/test/resources/testconfiguration.properties
URL: http://svn.apache.org/viewvc/hive/branches/spark/itests/src/test/resources/testconfiguration.properties?rev=1643162&r1=1643161&r2=1643162&view=diff
==============================================================================
--- hive/branches/spark/itests/src/test/resources/testconfiguration.properties (original)
+++ hive/branches/spark/itests/src/test/resources/testconfiguration.properties Fri Dec 5 06:57:48 2014
@@ -738,6 +738,7 @@ spark.query.files=add_part_multiple.q, \
ppd_join.q, \
ppd_join2.q, \
ppd_join3.q, \
+ ppd_join4.q, \
ppd_join5.q, \
ppd_join_filter.q, \
ppd_outer_join1.q, \
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_join4.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_join4.q.out?rev=1643162&r1=1643161&r2=1643162&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_join4.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_join4.q.out Fri Dec 5 06:57:48 2014
@@ -46,11 +46,14 @@ where t2.name='c' and t3.id='a'
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
Stage-1 is a root stage
- Stage-0 is a root stage
+ Stage-0 depends on stages: Stage-1
STAGE PLANS:
Stage: Stage-1
Spark
+ Edges:
+ Reducer 2 <- Map 1 (SORT, 3)
+ Reducer 3 <- Map 4 (PARTITION-LEVEL SORT, 3), Reducer 2 (PARTITION-LEVEL SORT, 3)
#### A masked pattern was here ####
Vertices:
Map 1
@@ -63,16 +66,11 @@ STAGE PLANS:
Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
Select Operator
Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
- Spark HashTable Sink Operator
- condition expressions:
- 0
- 1
- keys:
- 0 'a' (type: string)
- 1 'a' (type: string)
- Local Work:
- Map Reduce Local Work
- Map 2
+ Reduce Output Operator
+ key expressions: 'a' (type: string)
+ sort order: +
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Map 4
Map Operator Tree:
TableScan
alias: t3
@@ -80,15 +78,36 @@ STAGE PLANS:
Filter Operator
predicate: (id = 'a') (type: boolean)
Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
- Spark HashTable Sink Operator
- condition expressions:
- 0
- 1
- keys:
- 0 'a' (type: string)
- 1 'a' (type: string)
- Local Work:
- Map Reduce Local Work
+ Reduce Output Operator
+ key expressions: 'a' (type: string)
+ sort order: +
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Reducer 2
+ Reduce Operator Tree:
+ Reduce Output Operator
+ key expressions: 'a' (type: string)
+ sort order: +
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Reducer 3
+ Reduce Operator Tree:
+ Join Operator
+ condition map:
+ Inner Join 0 to 1
+ condition expressions:
+ 0
+ 1
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Select Operator
+ expressions: 'a' (type: string), 'c' (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Stage: Stage-0
Fetch Operator
@@ -104,7 +123,6 @@ where t2.name='c' and t3.id='a'
PREHOOK: type: QUERY
PREHOOK: Input: default@test_tbl
#### A masked pattern was here ####
-Status: Failed
POSTHOOK: query: select t2.*
from
(select id,name from (select id,name from test_tbl) t1 sort by id) t2