You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by chengxiang li <ch...@intel.com> on 2014/08/15 03:35:57 UTC
Review Request 24729: HIVE-7677 Implement native HiveReduceFunction
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24729/
-----------------------------------------------------------
Review request for hive, Brock Noland and Szehon Ho.
Bugs: HIVE-7677
https://issues.apache.org/jira/browse/HIVE-7677
Repository: hive-git
Description
-------
Similar as HiveMapFunction, We need implement native HiveReduceFunction, as the bridge between Spark framework and Hive operators.
Diffs
-----
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveMapFunctionResultList.java 2510324
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveReduceFunction.java fa12b0a
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveReduceFunctionResultList.java 2b7e538
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkMapRecordHandler.java e44ca23
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkRecordHandler.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkReduceRecordHandler.java PRE-CREATION
Diff: https://reviews.apache.org/r/24729/diff/
Testing
-------
Thanks,
chengxiang li
Re: Review Request 24729: HIVE-7677 Implement native
HiveReduceFunction
Posted by chengxiang li <ch...@intel.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24729/
-----------------------------------------------------------
(Updated 八月 15, 2014, 1:36 a.m.)
Review request for hive, Brock Noland and Szehon Ho.
Changes
-------
Implement SparkReduceRecordHandler to process records. Refactor SparkMapRecordHandler and SparkReduceRecordHandler to extract same logic into abstract parent class.
Bugs: HIVE-7677
https://issues.apache.org/jira/browse/HIVE-7677
Repository: hive-git
Description
-------
Similar as HiveMapFunction, We need implement native HiveReduceFunction, as the bridge between Spark framework and Hive operators.
Diffs (updated)
-----
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveMapFunctionResultList.java 2510324
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveReduceFunction.java fa12b0a
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveReduceFunctionResultList.java 2b7e538
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkMapRecordHandler.java e44ca23
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkRecordHandler.java PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkReduceRecordHandler.java PRE-CREATION
Diff: https://reviews.apache.org/r/24729/diff/
Testing
-------
Thanks,
chengxiang li