You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Gabor Gevay (JIRA)" <ji...@apache.org> on 2016/01/25 14:15:40 UTC
[jira] [Commented] (FLINK-2246) Add chained combine driver strategy
for ReduceFunction
[ https://issues.apache.org/jira/browse/FLINK-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115174#comment-15115174 ]
Gabor Gevay commented on FLINK-2246:
------------------------------------
I have added a commit to https://github.com/apache/flink/pull/1517 , which adds the chained version of ReduceCombineDriver.
> Add chained combine driver strategy for ReduceFunction
> ------------------------------------------------------
>
> Key: FLINK-2246
> URL: https://issues.apache.org/jira/browse/FLINK-2246
> Project: Flink
> Issue Type: Improvement
> Components: Local Runtime
> Affects Versions: 0.9, 0.10.0
> Reporter: Ufuk Celebi
> Assignee: Gabor Gevay
> Priority: Minor
>
> Running the WordCount example with a text file input/output results and a manual reduce function (instead of the sum(1)) results in a combiner, which is not chained.
> Replace sum(1) with the following to reproduce and use a text file as input:
> {code}
> fileOutput = true;
> textPath = "...";
> outputPath = "...";
> {code}
> {code}
> .reduce(new ReduceFunction<Tuple2<String, Integer>>() {
> @Override
> public Tuple2<String, Integer> reduce(Tuple2<String, Integer> value1, Tuple2<String, Integer> value2) throws Exception {
> return new Tuple2<String, Integer>(value1.f0, value1.f1 + value2.f1);
> }
> });
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)