You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Gabor Gevay (JIRA)" <ji...@apache.org> on 2016/01/25 14:15:40 UTC

[jira] [Commented] (FLINK-2246) Add chained combine driver strategy for ReduceFunction

    [ https://issues.apache.org/jira/browse/FLINK-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115174#comment-15115174 ] 

Gabor Gevay commented on FLINK-2246:
------------------------------------

I have added a commit to https://github.com/apache/flink/pull/1517 , which adds the chained version of ReduceCombineDriver.

> Add chained combine driver strategy for ReduceFunction
> ------------------------------------------------------
>
>                 Key: FLINK-2246
>                 URL: https://issues.apache.org/jira/browse/FLINK-2246
>             Project: Flink
>          Issue Type: Improvement
>          Components: Local Runtime
>    Affects Versions: 0.9, 0.10.0
>            Reporter: Ufuk Celebi
>            Assignee: Gabor Gevay
>            Priority: Minor
>
> Running the WordCount example with a text file input/output results and a manual reduce function (instead of the sum(1)) results in a combiner, which is not chained.
> Replace sum(1) with the following to reproduce and use a text file as input:
> {code}
> fileOutput = true;
> textPath = "...";
> outputPath = "...";
> {code}
> {code}
> .reduce(new ReduceFunction<Tuple2<String, Integer>>() {
>     @Override
>     public Tuple2<String, Integer> reduce(Tuple2<String, Integer> value1, Tuple2<String, Integer> value2) throws Exception {
>         return new Tuple2<String, Integer>(value1.f0, value1.f1 + value2.f1);
>     }    
> });
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)