You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hive.apache.org by br...@apache.org on 2014/12/29 03:14:00 UTC
svn commit: r1648280 [20/25] - in /hive/branches/spark: data/conf/spark/
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/
ql/src/java/org/apache/hadoop/hive/ql/optimizer/optiq/
ql/src/test/results/clientpositive/spark/
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_multi_insert.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_multi_insert.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_multi_insert.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_multi_insert.q.out Mon Dec 29 02:13:57 2014
@@ -41,8 +41,7 @@ INSERT OVERWRITE TABLE mi3 PARTITION(ds=
INSERT OVERWRITE DIRECTORY 'target/warehouse/mi4.out' SELECT a.value WHERE a.key >= 300
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-8 is a root stage
- Stage-4 depends on stages: Stage-8
+ Stage-4 is a root stage
Stage-0 depends on stages: Stage-4
Stage-5 depends on stages: Stage-0
Stage-1 depends on stages: Stage-4
@@ -52,114 +51,108 @@ STAGE DEPENDENCIES:
Stage-3 depends on stages: Stage-4
STAGE PLANS:
- Stage: Stage-8
+ Stage: Stage-4
Spark
+ Edges:
+ Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 1), Map 3 (PARTITION-LEVEL SORT, 1)
#### A masked pattern was here ####
Vertices:
- Map 2
+ Map 1
Map Operator Tree:
TableScan
- alias: b
+ alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: key is not null (type: boolean)
Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
- Spark HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1
- keys:
- 0 key (type: string)
- 1 key (type: string)
- Local Work:
- Map Reduce Local Work
-
- Stage: Stage-4
- Spark
-#### A masked pattern was here ####
- Vertices:
- Map 1
+ Reduce Output Operator
+ key expressions: key (type: string)
+ sort order: +
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
+ value expressions: value (type: string)
+ Map 3
Map Operator Tree:
TableScan
- alias: a
+ alias: b
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: key is not null (type: boolean)
Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
- Map Join Operator
- condition map:
- Inner Join 0 to 1
- condition expressions:
- 0 {key} {value}
- 1
- keys:
- 0 key (type: string)
- 1 key (type: string)
- outputColumnNames: _col0, _col1
- input vertices:
- 1 Map 2
- Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
- Filter Operator
- predicate: (_col0 < 100) (type: boolean)
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
- outputColumnNames: _col0, _col1
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.mi1
- Filter Operator
- predicate: ((_col0 >= 100) and (_col0 < 200)) (type: boolean)
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
- outputColumnNames: _col0, _col1
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.mi2
- Filter Operator
- predicate: ((_col0 >= 200) and (_col0 < 300)) (type: boolean)
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: UDFToInteger(_col0) (type: int)
- outputColumnNames: _col0
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.mi3
- Filter Operator
- predicate: (_col0 >= 300) (type: boolean)
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: _col1 (type: string)
- outputColumnNames: _col0
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- Local Work:
- Map Reduce Local Work
+ Reduce Output Operator
+ key expressions: key (type: string)
+ sort order: +
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
+ Reducer 2
+ Reduce Operator Tree:
+ Join Operator
+ condition map:
+ Inner Join 0 to 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: (_col0 < 100) (type: boolean)
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.mi1
+ Filter Operator
+ predicate: ((_col0 >= 100) and (_col0 < 200)) (type: boolean)
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.mi2
+ Filter Operator
+ predicate: ((_col0 >= 200) and (_col0 < 300)) (type: boolean)
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: UDFToInteger(_col0) (type: int)
+ outputColumnNames: _col0
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.mi3
+ Filter Operator
+ predicate: (_col0 >= 300) (type: boolean)
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: _col1 (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Stage: Stage-0
Move Operator
@@ -828,468 +821,468 @@ POSTHOOK: Input: default@mi3@ds=2008-04-
298 2008-04-08 12
298 2008-04-08 12
298 2008-04-08 12
+val_302
+val_305
+val_306
+val_307
+val_307
+val_307
+val_307
+val_308
+val_309
+val_309
+val_309
+val_309
+val_310
+val_311
val_311
val_311
val_311
-val_409
-val_409
-val_409
-val_484
-val_401
-val_401
-val_401
-val_401
-val_401
-val_369
-val_369
-val_369
-val_406
-val_406
-val_406
-val_406
-val_429
-val_429
-val_374
-val_469
-val_469
-val_469
-val_469
-val_469
-val_495
-val_327
-val_327
-val_327
-val_403
-val_403
-val_403
-val_417
-val_417
-val_417
-val_430
-val_430
-val_430
-val_338
-val_446
-val_459
-val_459
-val_394
-val_482
-val_413
-val_413
-val_494
-val_466
-val_466
-val_466
-val_399
-val_399
-val_396
-val_396
-val_396
-val_417
-val_417
-val_417
-val_489
-val_489
-val_489
-val_489
-val_377
-val_397
-val_397
-val_309
-val_309
-val_365
-val_439
-val_439
-val_342
-val_342
-val_367
-val_367
-val_325
-val_325
-val_475
-val_339
-val_455
val_311
val_311
val_311
+val_311
+val_311
+val_315
val_316
val_316
val_316
-val_302
-val_438
-val_438
-val_438
-val_345
-val_489
-val_489
-val_489
-val_489
-val_378
-val_427
-val_356
-val_399
-val_399
-val_382
-val_382
-val_498
-val_498
-val_498
-val_386
-val_437
-val_469
-val_469
-val_469
-val_469
-val_469
-val_459
-val_459
-val_430
-val_430
-val_430
+val_316
+val_316
+val_316
+val_316
+val_316
+val_316
+val_317
+val_317
+val_317
+val_317
+val_318
+val_318
+val_318
+val_318
val_318
val_318
val_318
+val_318
+val_318
+val_321
+val_321
+val_321
+val_321
+val_322
+val_322
+val_322
+val_322
+val_323
+val_325
+val_325
+val_325
+val_325
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
+val_331
+val_331
+val_331
+val_331
val_332
-val_311
-val_311
-val_311
val_333
val_333
-val_404
-val_404
-val_384
-val_384
-val_384
-val_489
-val_489
-val_489
-val_489
-val_353
-val_353
-val_373
+val_333
+val_333
+val_335
+val_336
+val_338
+val_339
+val_341
+val_342
+val_342
+val_342
+val_342
+val_344
+val_344
+val_344
+val_344
+val_345
val_348
val_348
val_348
val_348
val_348
-val_466
-val_466
-val_466
-val_411
val_348
val_348
val_348
val_348
val_348
-val_463
-val_463
-val_431
-val_431
-val_431
-val_496
-val_322
-val_322
-val_468
-val_468
-val_468
-val_468
-val_393
-val_454
-val_454
-val_454
-val_418
-val_327
-val_327
-val_327
-val_404
-val_404
-val_436
-val_469
-val_469
-val_469
-val_469
-val_469
-val_468
-val_468
-val_468
-val_468
-val_308
-val_481
-val_457
-val_318
-val_318
-val_318
-val_318
-val_318
-val_318
-val_409
-val_409
-val_409
-val_470
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_351
+val_353
+val_353
+val_353
+val_353
+val_356
+val_360
+val_362
+val_364
+val_365
+val_366
+val_367
+val_367
+val_367
+val_367
+val_368
+val_369
val_369
val_369
val_369
-val_316
-val_316
-val_316
-val_413
-val_413
-val_490
-val_364
-val_395
-val_395
-val_419
-val_307
-val_307
-val_435
-val_306
-val_309
-val_309
-val_389
-val_327
-val_327
-val_327
val_369
val_369
val_369
+val_369
+val_369
+val_373
+val_374
+val_375
+val_377
+val_378
+val_379
+val_382
+val_382
+val_382
+val_382
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_386
+val_389
val_392
-val_331
-val_331
+val_393
+val_394
+val_395
+val_395
+val_395
+val_395
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_397
+val_397
+val_397
+val_397
+val_399
+val_399
+val_399
+val_399
+val_400
val_401
val_401
val_401
val_401
val_401
-val_452
-val_497
-val_402
-val_396
-val_396
-val_396
-val_317
-val_317
-val_395
-val_395
-val_336
-val_472
-val_322
-val_322
-val_498
-val_498
-val_498
-val_321
-val_321
-val_430
-val_430
-val_430
-val_489
-val_489
-val_489
-val_489
-val_458
-val_458
-val_492
-val_492
-val_449
-val_453
-val_468
-val_468
-val_468
-val_468
-val_342
-val_342
-val_368
-val_367
-val_367
-val_344
-val_344
-val_485
-val_487
-val_480
-val_480
-val_480
val_401
val_401
val_401
val_401
val_401
-val_438
-val_438
-val_438
-val_467
-val_432
-val_316
-val_316
-val_316
-val_469
-val_469
-val_469
-val_469
-val_469
-val_463
-val_463
-val_331
-val_331
-val_321
-val_321
-val_335
-val_466
-val_466
-val_466
-val_366
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_402
val_403
val_403
val_403
-val_483
+val_403
+val_403
+val_403
+val_403
+val_403
+val_403
+val_404
+val_404
+val_404
+val_404
val_406
val_406
val_406
val_406
-val_409
-val_409
-val_409
val_406
val_406
val_406
val_406
-val_401
-val_401
-val_401
-val_401
-val_401
-val_348
-val_348
-val_348
-val_348
-val_348
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_407
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_411
+val_413
+val_413
+val_413
+val_413
+val_414
+val_414
+val_414
+val_414
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_418
+val_419
+val_421
val_424
val_424
-val_396
-val_396
-val_396
+val_424
+val_424
+val_427
+val_429
+val_429
+val_429
+val_429
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
val_431
val_431
val_431
-val_454
-val_454
-val_454
-val_478
-val_478
val_431
val_431
val_431
-val_424
-val_424
-val_382
-val_382
-val_397
-val_397
-val_480
-val_480
-val_480
-val_351
+val_431
+val_431
+val_431
+val_432
+val_435
+val_436
+val_437
+val_438
+val_438
+val_438
+val_438
+val_438
+val_438
val_438
val_438
val_438
-val_414
-val_414
-val_491
val_439
val_439
-val_360
-val_479
-val_305
-val_417
-val_417
-val_417
-val_444
-val_429
-val_429
+val_439
+val_439
val_443
-val_323
-val_325
-val_325
-val_478
-val_478
+val_444
+val_446
+val_448
+val_449
+val_452
+val_453
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_455
+val_457
+val_458
+val_458
+val_458
+val_458
+val_459
+val_459
+val_459
+val_459
+val_460
+val_462
+val_462
+val_462
+val_462
+val_463
+val_463
+val_463
+val_463
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_467
val_468
val_468
val_468
val_468
-val_310
-val_317
-val_317
-val_333
-val_333
-val_493
-val_460
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_470
+val_472
+val_475
+val_477
+val_478
+val_478
+val_478
+val_478
+val_479
val_480
val_480
val_480
-val_353
-val_353
-val_462
-val_462
-val_406
-val_406
-val_406
-val_406
-val_454
-val_454
-val_454
-val_375
-val_401
-val_401
-val_401
-val_401
-val_401
-val_421
-val_407
-val_384
-val_384
-val_384
-val_384
-val_384
-val_384
-val_379
-val_462
-val_462
+val_480
+val_480
+val_480
+val_480
+val_480
+val_480
+val_481
+val_482
+val_483
+val_484
+val_485
+val_487
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_490
+val_491
val_492
val_492
-val_341
+val_492
+val_492
+val_493
+val_494
+val_495
+val_496
+val_497
+val_498
+val_498
+val_498
+val_498
+val_498
+val_498
val_498
val_498
val_498
-val_458
-val_458
-val_362
-val_348
-val_348
-val_348
-val_348
-val_348
-val_344
-val_344
-val_469
-val_469
-val_469
-val_469
-val_469
-val_315
-val_448
-val_348
-val_348
-val_348
-val_348
-val_348
-val_307
-val_307
-val_414
-val_414
-val_477
-val_403
-val_403
-val_403
-val_400
PREHOOK: query: EXPLAIN
FROM src a JOIN src b ON (a.key = b.key)
INSERT OVERWRITE TABLE mi1 SELECT a.* WHERE a.key < 100
@@ -1305,8 +1298,7 @@ INSERT OVERWRITE TABLE mi3 PARTITION(ds=
INSERT OVERWRITE DIRECTORY 'target/warehouse/mi4.out' SELECT a.value WHERE a.key >= 300
POSTHOOK: type: QUERY
STAGE DEPENDENCIES:
- Stage-8 is a root stage
- Stage-4 depends on stages: Stage-8
+ Stage-4 is a root stage
Stage-0 depends on stages: Stage-4
Stage-5 depends on stages: Stage-0
Stage-1 depends on stages: Stage-4
@@ -1316,114 +1308,108 @@ STAGE DEPENDENCIES:
Stage-3 depends on stages: Stage-4
STAGE PLANS:
- Stage: Stage-8
+ Stage: Stage-4
Spark
+ Edges:
+ Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 3), Map 3 (PARTITION-LEVEL SORT, 3)
#### A masked pattern was here ####
Vertices:
- Map 2
+ Map 1
Map Operator Tree:
TableScan
- alias: b
+ alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: key is not null (type: boolean)
Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
- Spark HashTable Sink Operator
- condition expressions:
- 0 {key} {value}
- 1
- keys:
- 0 key (type: string)
- 1 key (type: string)
- Local Work:
- Map Reduce Local Work
-
- Stage: Stage-4
- Spark
-#### A masked pattern was here ####
- Vertices:
- Map 1
+ Reduce Output Operator
+ key expressions: key (type: string)
+ sort order: +
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
+ value expressions: value (type: string)
+ Map 3
Map Operator Tree:
TableScan
- alias: a
+ alias: b
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: key is not null (type: boolean)
Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
- Map Join Operator
- condition map:
- Inner Join 0 to 1
- condition expressions:
- 0 {key} {value}
- 1
- keys:
- 0 key (type: string)
- 1 key (type: string)
- outputColumnNames: _col0, _col1
- input vertices:
- 1 Map 2
- Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
- Filter Operator
- predicate: (_col0 < 100) (type: boolean)
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
- outputColumnNames: _col0, _col1
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.mi1
- Filter Operator
- predicate: ((_col0 >= 100) and (_col0 < 200)) (type: boolean)
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
- outputColumnNames: _col0, _col1
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.mi2
- Filter Operator
- predicate: ((_col0 >= 200) and (_col0 < 300)) (type: boolean)
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: UDFToInteger(_col0) (type: int)
- outputColumnNames: _col0
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- name: default.mi3
- Filter Operator
- predicate: (_col0 >= 300) (type: boolean)
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: _col1 (type: string)
- outputColumnNames: _col0
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
- Local Work:
- Map Reduce Local Work
+ Reduce Output Operator
+ key expressions: key (type: string)
+ sort order: +
+ Map-reduce partition columns: key (type: string)
+ Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
+ Reducer 2
+ Reduce Operator Tree:
+ Join Operator
+ condition map:
+ Inner Join 0 to 1
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 275 Data size: 2921 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: (_col0 < 100) (type: boolean)
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.mi1
+ Filter Operator
+ predicate: ((_col0 >= 100) and (_col0 < 200)) (type: boolean)
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: UDFToInteger(_col0) (type: int), _col1 (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.mi2
+ Filter Operator
+ predicate: ((_col0 >= 200) and (_col0 < 300)) (type: boolean)
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: UDFToInteger(_col0) (type: int)
+ outputColumnNames: _col0
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 30 Data size: 318 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ name: default.mi3
+ Filter Operator
+ predicate: (_col0 >= 300) (type: boolean)
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: _col1 (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 91 Data size: 966 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
Stage: Stage-0
Move Operator
@@ -2092,465 +2078,465 @@ POSTHOOK: Input: default@mi3@ds=2008-04-
298 2008-04-08 12
298 2008-04-08 12
298 2008-04-08 12
-val_311
-val_311
-val_311
-val_409
-val_409
-val_409
-val_484
-val_401
-val_401
-val_401
-val_401
-val_401
-val_369
-val_369
-val_369
-val_406
-val_406
-val_406
-val_406
-val_429
-val_429
-val_374
-val_469
-val_469
-val_469
-val_469
-val_469
-val_495
-val_327
-val_327
-val_327
-val_403
-val_403
-val_403
-val_417
-val_417
-val_417
-val_430
-val_430
-val_430
-val_338
-val_446
-val_459
-val_459
-val_394
-val_482
-val_413
-val_413
-val_494
-val_466
-val_466
-val_466
-val_399
-val_399
-val_396
-val_396
-val_396
-val_417
-val_417
-val_417
-val_489
-val_489
-val_489
-val_489
-val_377
-val_397
-val_397
+val_306
val_309
val_309
-val_365
-val_439
-val_439
-val_342
-val_342
-val_367
-val_367
-val_325
-val_325
-val_475
-val_339
-val_455
-val_311
-val_311
-val_311
-val_316
-val_316
-val_316
-val_302
-val_438
-val_438
-val_438
-val_345
-val_489
-val_489
-val_489
-val_489
-val_378
-val_427
-val_356
-val_399
-val_399
-val_382
-val_382
-val_498
-val_498
-val_498
-val_386
-val_437
-val_469
-val_469
-val_469
-val_469
-val_469
-val_459
-val_459
-val_430
-val_430
-val_430
+val_309
+val_309
+val_315
val_318
val_318
val_318
-val_332
-val_311
-val_311
-val_311
+val_318
+val_318
+val_318
+val_318
+val_318
+val_318
+val_321
+val_321
+val_321
+val_321
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
+val_327
val_333
val_333
-val_404
-val_404
-val_384
-val_384
-val_384
-val_489
-val_489
-val_489
-val_489
-val_353
-val_353
-val_373
+val_333
+val_333
+val_336
+val_339
+val_342
+val_342
+val_342
+val_342
+val_345
val_348
val_348
val_348
val_348
val_348
-val_466
-val_466
-val_466
-val_411
val_348
val_348
val_348
val_348
val_348
-val_463
-val_463
-val_431
-val_431
-val_431
-val_496
-val_322
-val_322
-val_468
-val_468
-val_468
-val_468
-val_393
-val_454
-val_454
-val_454
-val_418
-val_327
-val_327
-val_327
-val_404
-val_404
-val_436
-val_469
-val_469
-val_469
-val_469
-val_469
-val_468
-val_468
-val_468
-val_468
-val_308
-val_481
-val_457
-val_318
-val_318
-val_318
-val_318
-val_318
-val_318
-val_409
-val_409
-val_409
-val_470
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_348
+val_351
+val_360
+val_366
val_369
val_369
val_369
-val_316
-val_316
-val_316
-val_413
-val_413
-val_490
-val_364
-val_395
-val_395
-val_419
-val_307
-val_307
-val_435
-val_306
-val_309
-val_309
-val_389
-val_327
-val_327
-val_327
val_369
val_369
val_369
+val_369
+val_369
+val_369
+val_375
+val_378
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_384
+val_393
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_396
+val_399
+val_399
+val_399
+val_399
+val_402
+val_411
+val_414
+val_414
+val_414
+val_414
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_417
+val_429
+val_429
+val_429
+val_429
+val_432
+val_435
+val_438
+val_438
+val_438
+val_438
+val_438
+val_438
+val_438
+val_438
+val_438
+val_444
+val_453
+val_459
+val_459
+val_459
+val_459
+val_462
+val_462
+val_462
+val_462
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_468
+val_477
+val_480
+val_480
+val_480
+val_480
+val_480
+val_480
+val_480
+val_480
+val_480
+val_483
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_489
+val_492
+val_492
+val_492
+val_492
+val_495
+val_498
+val_498
+val_498
+val_498
+val_498
+val_498
+val_498
+val_498
+val_498
+val_307
+val_307
+val_307
+val_307
+val_310
+val_316
+val_316
+val_316
+val_316
+val_316
+val_316
+val_316
+val_316
+val_316
+val_322
+val_322
+val_322
+val_322
+val_325
+val_325
+val_325
+val_325
+val_331
+val_331
+val_331
+val_331
+val_364
+val_367
+val_367
+val_367
+val_367
+val_373
+val_379
+val_382
+val_382
+val_382
+val_382
+val_394
+val_397
+val_397
+val_397
+val_397
+val_400
+val_403
+val_403
+val_403
+val_403
+val_403
+val_403
+val_403
+val_403
+val_403
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_406
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_409
+val_418
+val_421
+val_424
+val_424
+val_424
+val_424
+val_427
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
+val_430
+val_436
+val_439
+val_439
+val_439
+val_439
+val_448
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_454
+val_457
+val_460
+val_463
+val_463
+val_463
+val_463
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_466
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_469
+val_472
+val_475
+val_478
+val_478
+val_478
+val_478
+val_481
+val_484
+val_487
+val_490
+val_493
+val_496
+val_302
+val_305
+val_308
+val_311
+val_311
+val_311
+val_311
+val_311
+val_311
+val_311
+val_311
+val_311
+val_317
+val_317
+val_317
+val_317
+val_323
+val_332
+val_335
+val_338
+val_341
+val_344
+val_344
+val_344
+val_344
+val_353
+val_353
+val_353
+val_353
+val_356
+val_362
+val_365
+val_368
+val_374
+val_377
+val_386
+val_389
val_392
-val_331
-val_331
+val_395
+val_395
+val_395
+val_395
val_401
val_401
val_401
val_401
val_401
-val_452
-val_497
-val_402
-val_396
-val_396
-val_396
-val_317
-val_317
-val_395
-val_395
-val_336
-val_472
-val_322
-val_322
-val_498
-val_498
-val_498
-val_321
-val_321
-val_430
-val_430
-val_430
-val_489
-val_489
-val_489
-val_489
-val_458
-val_458
-val_492
-val_492
-val_449
-val_453
-val_468
-val_468
-val_468
-val_468
-val_342
-val_342
-val_368
-val_367
-val_367
-val_344
-val_344
-val_485
-val_487
-val_480
-val_480
-val_480
val_401
val_401
val_401
val_401
val_401
-val_438
-val_438
-val_438
-val_467
-val_432
-val_316
-val_316
-val_316
-val_469
-val_469
-val_469
-val_469
-val_469
-val_463
-val_463
-val_331
-val_331
-val_321
-val_321
-val_335
-val_466
-val_466
-val_466
-val_366
-val_403
-val_403
-val_403
-val_483
-val_406
-val_406
-val_406
-val_406
-val_409
-val_409
-val_409
-val_406
-val_406
-val_406
-val_406
val_401
val_401
val_401
val_401
val_401
-val_348
-val_348
-val_348
-val_348
-val_348
-val_424
-val_424
-val_396
-val_396
-val_396
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_401
+val_404
+val_404
+val_404
+val_404
+val_407
+val_413
+val_413
+val_413
+val_413
+val_419
val_431
val_431
val_431
-val_454
-val_454
-val_454
-val_478
-val_478
val_431
val_431
val_431
-val_424
-val_424
-val_382
-val_382
-val_397
-val_397
-val_480
-val_480
-val_480
-val_351
-val_438
-val_438
-val_438
-val_414
-val_414
-val_491
-val_439
-val_439
-val_360
-val_479
-val_305
-val_417
-val_417
-val_417
-val_444
-val_429
-val_429
+val_431
+val_431
+val_431
+val_437
val_443
-val_323
-val_325
-val_325
-val_478
-val_478
-val_468
-val_468
-val_468
-val_468
-val_310
-val_317
-val_317
-val_333
-val_333
-val_493
-val_460
-val_480
-val_480
-val_480
-val_353
-val_353
-val_462
-val_462
-val_406
-val_406
-val_406
-val_406
-val_454
-val_454
-val_454
-val_375
-val_401
-val_401
-val_401
-val_401
-val_401
-val_421
-val_407
-val_384
-val_384
-val_384
-val_384
-val_384
-val_384
-val_379
-val_462
-val_462
-val_492
-val_492
-val_341
-val_498
-val_498
-val_498
+val_446
+val_449
+val_452
+val_455
val_458
val_458
-val_362
-val_348
-val_348
-val_348
-val_348
-val_348
-val_344
-val_344
-val_469
-val_469
-val_469
-val_469
-val_469
-val_315
-val_448
-val_348
-val_348
-val_348
-val_348
-val_348
-val_307
-val_307
-val_414
-val_414
-val_477
-val_403
-val_403
-val_403
-val_400
+val_458
+val_458
+val_467
+val_470
+val_479
+val_482
+val_485
+val_491
+val_494
+val_497
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join1.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join1.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join1.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join1.q.out Mon Dec 29 02:13:57 2014
@@ -64,9 +64,9 @@ STAGE PLANS:
Join Operator
condition map:
Left Outer Join0 to 1
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
outputColumnNames: _col0, _col1, _col5, _col6
Statistics: Num rows: 60 Data size: 642 Basic stats: COMPLETE Column stats: NONE
Filter Operator
@@ -178,9 +178,9 @@ STAGE PLANS:
Join Operator
condition map:
Left Outer Join0 to 1
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
outputColumnNames: _col0, _col1, _col5, _col6
Statistics: Num rows: 60 Data size: 642 Basic stats: COMPLETE Column stats: NONE
Filter Operator
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join2.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join2.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join2.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join2.q.out Mon Dec 29 02:13:57 2014
@@ -64,9 +64,9 @@ STAGE PLANS:
Join Operator
condition map:
Right Outer Join0 to 1
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
outputColumnNames: _col0, _col1, _col5, _col6
Statistics: Num rows: 60 Data size: 642 Basic stats: COMPLETE Column stats: NONE
Filter Operator
@@ -298,9 +298,9 @@ STAGE PLANS:
Join Operator
condition map:
Right Outer Join0 to 1
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
outputColumnNames: _col0, _col1, _col5, _col6
Statistics: Num rows: 60 Data size: 642 Basic stats: COMPLETE Column stats: NONE
Filter Operator
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join3.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join3.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join3.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join3.q.out Mon Dec 29 02:13:57 2014
@@ -58,9 +58,9 @@ STAGE PLANS:
Join Operator
condition map:
Outer Join 0 to 1
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
outputColumnNames: _col0, _col1, _col5, _col6
Statistics: Num rows: 550 Data size: 5843 Basic stats: COMPLETE Column stats: NONE
Filter Operator
@@ -286,9 +286,9 @@ STAGE PLANS:
Join Operator
condition map:
Outer Join 0 to 1
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
+ keys:
+ 0 key (type: string)
+ 1 key (type: string)
outputColumnNames: _col0, _col1, _col5, _col6
Statistics: Num rows: 550 Data size: 5843 Basic stats: COMPLETE Column stats: NONE
Filter Operator
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join4.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join4.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join4.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join4.q.out Mon Dec 29 02:13:57 2014
@@ -34,7 +34,8 @@ STAGE PLANS:
Stage: Stage-1
Spark
Edges:
- Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 1), Map 3 (PARTITION-LEVEL SORT, 1), Map 4 (PARTITION-LEVEL SORT, 1)
+ Reducer 4 <- Map 3 (PARTITION-LEVEL SORT, 1), Map 5 (PARTITION-LEVEL SORT, 1)
+ Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 1), Reducer 4 (PARTITION-LEVEL SORT, 1)
#### A masked pattern was here ####
Vertices:
Map 1
@@ -43,67 +44,114 @@ STAGE PLANS:
alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate: (sqrt(key) <> 13) (type: boolean)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Reduce Output Operator
- key expressions: key (type: string)
- sort order: +
- Map-reduce partition columns: key (type: string)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- value expressions: value (type: string)
+ predicate: ((((((sqrt(key) <> 13.0) and (key > '10')) and (key < '20')) and (key > '15')) and (key < '25')) and key is not null) (type: boolean)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: key (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: ((_col0 > '10') and ((_col0 < '20') and ((_col0 > '15') and (_col0 < '25')))) (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Filter Operator
+ predicate: _col0 is not null (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
Map 3
Map Operator Tree:
TableScan
- alias: b
+ alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate: (sqrt(key) <> 13) (type: boolean)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Reduce Output Operator
- key expressions: key (type: string)
- sort order: +
- Map-reduce partition columns: key (type: string)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- value expressions: value (type: string)
- Map 4
+ predicate: ((((((key > '10') and (key < '20')) and (key > '15')) and (key < '25')) and key is not null) and (sqrt(key) <> 13.0)) (type: boolean)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: key (type: string), value (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: ((_col0 > '15') and (_col0 < '25')) (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Filter Operator
+ predicate: _col0 is not null (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ value expressions: _col1 (type: string)
+ Map 5
Map Operator Tree:
TableScan
- alias: c
+ alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate: (sqrt(key) <> 13) (type: boolean)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Reduce Output Operator
- key expressions: key (type: string)
- sort order: +
- Map-reduce partition columns: key (type: string)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
+ predicate: ((((((key > '15') and (key < '25')) and (key > '10')) and (key < '20')) and key is not null) and (sqrt(key) <> 13.0)) (type: boolean)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: key (type: string), value (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Filter Operator
+ predicate: ((_col0 > '10') and (_col0 < '20')) (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Filter Operator
+ predicate: _col0 is not null (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ value expressions: _col1 (type: string)
Reducer 2
Reduce Operator Tree:
Join Operator
condition map:
- Left Outer Join0 to 1
- Right Outer Join0 to 2
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
- 2 {KEY.reducesinkkey0}
- outputColumnNames: _col0, _col1, _col5, _col6, _col10
- Statistics: Num rows: 1100 Data size: 11686 Basic stats: COMPLETE Column stats: NONE
+ Inner Join 0 to 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+ outputColumnNames: _col0, _col1, _col2, _col3, _col4
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Select Operator
+ expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col0 (type: string)
+ outputColumnNames: _col0, _col1, _col2, _col3, _col4
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ Reducer 4
+ Reduce Operator Tree:
+ Join Operator
+ condition map:
+ Inner Join 0 to 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+ outputColumnNames: _col0, _col1, _col2, _col3
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
Filter Operator
- predicate: (((((_col0 > '10') and (_col0 < '20')) and (_col5 > '15')) and (_col5 < '25')) and (sqrt(_col10) <> 13)) (type: boolean)
- Statistics: Num rows: 13 Data size: 138 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: _col0 (type: string), _col1 (type: string), _col5 (type: string), _col6 (type: string), _col10 (type: string)
- outputColumnNames: _col0, _col1, _col2, _col3, _col4
- Statistics: Num rows: 13 Data size: 138 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 13 Data size: 138 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ predicate: (sqrt(_col0) <> 13.0) (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Filter Operator
+ predicate: _col0 is not null (type: boolean)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
+ value expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string)
Stage: Stage-0
Fetch Operator
@@ -399,7 +447,8 @@ STAGE PLANS:
Stage: Stage-1
Spark
Edges:
- Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 3), Map 3 (PARTITION-LEVEL SORT, 3), Map 4 (PARTITION-LEVEL SORT, 3)
+ Reducer 4 <- Map 3 (PARTITION-LEVEL SORT, 3), Map 5 (PARTITION-LEVEL SORT, 3)
+ Reducer 2 <- Map 1 (PARTITION-LEVEL SORT, 3), Reducer 4 (PARTITION-LEVEL SORT, 3)
#### A masked pattern was here ####
Vertices:
Map 1
@@ -408,67 +457,90 @@ STAGE PLANS:
alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate: (sqrt(key) <> 13) (type: boolean)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Reduce Output Operator
- key expressions: key (type: string)
- sort order: +
- Map-reduce partition columns: key (type: string)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- value expressions: value (type: string)
+ predicate: ((((((sqrt(key) <> 13.0) and (key > '10')) and (key < '20')) and (key > '15')) and (key < '25')) and key is not null) (type: boolean)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: key (type: string)
+ outputColumnNames: _col0
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
Map 3
Map Operator Tree:
TableScan
- alias: b
+ alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate: (sqrt(key) <> 13) (type: boolean)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Reduce Output Operator
- key expressions: key (type: string)
- sort order: +
- Map-reduce partition columns: key (type: string)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- value expressions: value (type: string)
- Map 4
+ predicate: ((((((key > '10') and (key < '20')) and (key > '15')) and (key < '25')) and key is not null) and (sqrt(key) <> 13.0)) (type: boolean)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: key (type: string), value (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col1 (type: string)
+ Map 5
Map Operator Tree:
TableScan
- alias: c
+ alias: a
Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
Filter Operator
- predicate: (sqrt(key) <> 13) (type: boolean)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
- Reduce Output Operator
- key expressions: key (type: string)
- sort order: +
- Map-reduce partition columns: key (type: string)
- Statistics: Num rows: 500 Data size: 5312 Basic stats: COMPLETE Column stats: NONE
+ predicate: ((((((key > '15') and (key < '25')) and (key > '10')) and (key < '20')) and key is not null) and (sqrt(key) <> 13.0)) (type: boolean)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: key (type: string), value (type: string)
+ outputColumnNames: _col0, _col1
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 3 Data size: 31 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col1 (type: string)
Reducer 2
Reduce Operator Tree:
Join Operator
condition map:
- Left Outer Join0 to 1
- Right Outer Join0 to 2
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0}
- 1 {KEY.reducesinkkey0} {VALUE._col0}
- 2 {KEY.reducesinkkey0}
- outputColumnNames: _col0, _col1, _col5, _col6, _col10
- Statistics: Num rows: 1100 Data size: 11686 Basic stats: COMPLETE Column stats: NONE
- Filter Operator
- predicate: ((((_col5 > '15') and (_col5 < '25')) and (_col0 > '10')) and (_col0 < '20')) (type: boolean)
- Statistics: Num rows: 13 Data size: 138 Basic stats: COMPLETE Column stats: NONE
- Select Operator
- expressions: _col0 (type: string), _col1 (type: string), _col5 (type: string), _col6 (type: string), _col10 (type: string)
- outputColumnNames: _col0, _col1, _col2, _col3, _col4
- Statistics: Num rows: 13 Data size: 138 Basic stats: COMPLETE Column stats: NONE
- File Output Operator
- compressed: false
- Statistics: Num rows: 13 Data size: 138 Basic stats: COMPLETE Column stats: NONE
- table:
- input format: org.apache.hadoop.mapred.TextInputFormat
- output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
- serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ Inner Join 0 to 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+ outputColumnNames: _col0, _col1, _col2, _col3, _col4
+ Statistics: Num rows: 3 Data size: 34 Basic stats: COMPLETE Column stats: NONE
+ Select Operator
+ expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string), _col4 (type: string), _col0 (type: string)
+ outputColumnNames: _col0, _col1, _col2, _col3, _col4
+ Statistics: Num rows: 3 Data size: 34 Basic stats: COMPLETE Column stats: NONE
+ File Output Operator
+ compressed: false
+ Statistics: Num rows: 3 Data size: 34 Basic stats: COMPLETE Column stats: NONE
+ table:
+ input format: org.apache.hadoop.mapred.TextInputFormat
+ output format: org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat
+ serde: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
+ Reducer 4
+ Reduce Operator Tree:
+ Join Operator
+ condition map:
+ Inner Join 0 to 1
+ keys:
+ 0 _col0 (type: string)
+ 1 _col0 (type: string)
+ outputColumnNames: _col0, _col1, _col2, _col3
+ Statistics: Num rows: 3 Data size: 34 Basic stats: COMPLETE Column stats: NONE
+ Reduce Output Operator
+ key expressions: _col0 (type: string)
+ sort order: +
+ Map-reduce partition columns: _col0 (type: string)
+ Statistics: Num rows: 3 Data size: 34 Basic stats: COMPLETE Column stats: NONE
+ value expressions: _col1 (type: string), _col2 (type: string), _col3 (type: string)
Stage: Stage-0
Fetch Operator
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_outer_join5.q.out Mon Dec 29 02:13:57 2014
@@ -93,10 +93,10 @@ STAGE PLANS:
condition map:
Outer Join 0 to 1
Inner Join 1 to 2
- condition expressions:
- 0 {KEY.reducesinkkey0} {VALUE._col0} {VALUE._col1}
- 1 {KEY.reducesinkkey0} {VALUE._col0} {VALUE._col1}
- 2 {VALUE._col0} {VALUE._col1}
+ keys:
+ 0 id (type: int)
+ 1 id (type: int)
+ 2 id (type: int)
outputColumnNames: _col0, _col1, _col2, _col6, _col7, _col8, _col13, _col14
Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
Select Operator
@@ -180,10 +180,10 @@ STAGE PLANS:
condition map:
Inner Join 0 to 1
Left Outer Join1 to 2
- condition expressions:
- 0 {VALUE._col0} {VALUE._col1}
- 1 {VALUE._col0} {VALUE._col1}
- 2 {KEY.reducesinkkey0} {VALUE._col0} {VALUE._col1}
+ keys:
+ 0 id (type: int)
+ 1 id (type: int)
+ 2 id (type: int)
outputColumnNames: _col1, _col2, _col7, _col8, _col12, _col13, _col14
Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
Select Operator
@@ -267,10 +267,10 @@ STAGE PLANS:
condition map:
Inner Join 0 to 1
Left Outer Join0 to 2
- condition expressions:
- 0 {VALUE._col0} {VALUE._col1}
- 1 {VALUE._col0} {VALUE._col1}
- 2 {KEY.reducesinkkey0} {VALUE._col0} {VALUE._col1}
+ keys:
+ 0 id (type: int)
+ 1 id (type: int)
+ 2 id (type: int)
outputColumnNames: _col1, _col2, _col7, _col8, _col12, _col13, _col14
Statistics: Num rows: 0 Data size: 0 Basic stats: NONE Column stats: NONE
Select Operator
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_transform.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_transform.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_transform.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/ppd_transform.q.out Mon Dec 29 02:13:57 2014
@@ -80,6 +80,7 @@ PREHOOK: query: FROM (
) tmap
SELECT tmap.tkey, tmap.tvalue WHERE tmap.tkey < 100
PREHOOK: type: QUERY
+PREHOOK: Input: cat
PREHOOK: Input: default@src
#### A masked pattern was here ####
POSTHOOK: query: FROM (
@@ -90,6 +91,7 @@ POSTHOOK: query: FROM (
) tmap
SELECT tmap.tkey, tmap.tvalue WHERE tmap.tkey < 100
POSTHOOK: type: QUERY
+POSTHOOK: Input: cat
POSTHOOK: Input: default@src
#### A masked pattern was here ####
0 val_0
@@ -258,6 +260,7 @@ PREHOOK: query: FROM (
) tmap
SELECT tmap.tkey, tmap.tvalue WHERE tmap.tkey < 100
PREHOOK: type: QUERY
+PREHOOK: Input: cat
PREHOOK: Input: default@src
#### A masked pattern was here ####
POSTHOOK: query: FROM (
@@ -268,6 +271,7 @@ POSTHOOK: query: FROM (
) tmap
SELECT tmap.tkey, tmap.tvalue WHERE tmap.tkey < 100
POSTHOOK: type: QUERY
+POSTHOOK: Input: cat
POSTHOOK: Input: default@src
#### A masked pattern was here ####
0 val_0
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/reduce_deduplicate_exclude_join.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/reduce_deduplicate_exclude_join.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/reduce_deduplicate_exclude_join.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/reduce_deduplicate_exclude_join.q.out Mon Dec 29 02:13:57 2014
@@ -21,9 +21,6 @@ STAGE PLANS:
predicate: key is not null (type: boolean)
Statistics: Num rows: 250 Data size: 2656 Basic stats: COMPLETE Column stats: NONE
Spark HashTable Sink Operator
- condition expressions:
- 0 {_col0} {_col1}
- 1 {value}
keys:
0 _col0 (type: string)
1 key (type: string)
@@ -65,9 +62,6 @@ STAGE PLANS:
Map Join Operator
condition map:
Inner Join 0 to 1
- condition expressions:
- 0 {_col0} {_col1}
- 1 {key} {value}
keys:
0 _col0 (type: string)
1 key (type: string)
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/router_join_ppr.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/router_join_ppr.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/router_join_ppr.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/router_join_ppr.q.out Mon Dec 29 02:13:57 2014 differ
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample1.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample1.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/sample1.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/sample1.q.out Mon Dec 29 02:13:57 2014 differ
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample10.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample10.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
--- hive/branches/spark/ql/src/test/results/clientpositive/spark/sample10.q.out (original)
+++ hive/branches/spark/ql/src/test/results/clientpositive/spark/sample10.q.out Mon Dec 29 02:13:57 2014
@@ -137,7 +137,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -159,7 +159,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -185,7 +185,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -207,7 +207,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -233,7 +233,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -255,7 +255,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -281,7 +281,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -303,7 +303,7 @@ STAGE PLANS:
bucket_count 4
bucket_field_name key
columns key,value
- columns.comments
+ columns.comments
columns.types string:string
#### A masked pattern was here ####
name default.srcpartbucket
@@ -329,11 +329,11 @@ STAGE PLANS:
keys: KEY._col0 (type: string)
mode: mergepartial
outputColumnNames: _col0, _col1
- Statistics: Num rows: 20 Data size: 120 Basic stats: COMPLETE Column stats: NONE
+ Statistics: Num rows: 10 Data size: 60 Basic stats: COMPLETE Column stats: NONE
Reduce Output Operator
key expressions: _col0 (type: string)
sort order: +
- Statistics: Num rows: 20 Data size: 120 Basic stats: COMPLETE Column stats: NONE
+ Statistics: Num rows: 10 Data size: 60 Basic stats: COMPLETE Column stats: NONE
tag: -1
value expressions: _col1 (type: bigint)
auto parallelism: false
@@ -343,13 +343,13 @@ STAGE PLANS:
Select Operator
expressions: KEY.reducesinkkey0 (type: string), VALUE._col0 (type: bigint)
outputColumnNames: _col0, _col1
- Statistics: Num rows: 20 Data size: 120 Basic stats: COMPLETE Column stats: NONE
+ Statistics: Num rows: 10 Data size: 60 Basic stats: COMPLETE Column stats: NONE
File Output Operator
compressed: false
GlobalTableId: 0
#### A masked pattern was here ####
NumFilesPerFileSink: 1
- Statistics: Num rows: 20 Data size: 120 Basic stats: COMPLETE Column stats: NONE
+ Statistics: Num rows: 10 Data size: 60 Basic stats: COMPLETE Column stats: NONE
#### A masked pattern was here ####
table:
input format: org.apache.hadoop.mapred.TextInputFormat
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample2.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample2.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/sample2.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/sample2.q.out Mon Dec 29 02:13:57 2014 differ
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample4.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample4.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/sample4.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/sample4.q.out Mon Dec 29 02:13:57 2014 differ
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample5.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample5.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/sample5.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/sample5.q.out Mon Dec 29 02:13:57 2014 differ
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample6.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample6.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/sample6.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/sample6.q.out Mon Dec 29 02:13:57 2014 differ
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample7.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample7.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/sample7.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/sample7.q.out Mon Dec 29 02:13:57 2014 differ
Modified: hive/branches/spark/ql/src/test/results/clientpositive/spark/sample8.q.out
URL: http://svn.apache.org/viewvc/hive/branches/spark/ql/src/test/results/clientpositive/spark/sample8.q.out?rev=1648280&r1=1648279&r2=1648280&view=diff
==============================================================================
Binary files hive/branches/spark/ql/src/test/results/clientpositive/spark/sample8.q.out (original) and hive/branches/spark/ql/src/test/results/clientpositive/spark/sample8.q.out Mon Dec 29 02:13:57 2014 differ