You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Matthias J. Sax (JIRA)" <ji...@apache.org> on 2015/10/08 16:10:26 UTC

[jira] [Created] (FLINK-2837) FlinkTopologyBuilder cannot handle multiple input streams

Matthias J. Sax created FLINK-2837:
--------------------------------------

             Summary: FlinkTopologyBuilder cannot handle multiple input streams
                 Key: FLINK-2837
                 URL: https://issues.apache.org/jira/browse/FLINK-2837
             Project: Flink
          Issue Type: Bug
          Components: Storm Compatibility
            Reporter: Matthias J. Sax
            Assignee: Matthias J. Sax


FlinkTopologyBuilder cannot handle multiple input streams correctly. Instead of union the incoming streams, it replicates the consuming bolt and each (logical) instance processes one of the input streams.

For example:
{noformat}
final FlinkTopologyBuilder builder = new FlinkTopologyBuilder();

builder.setSpout(spoutId1, new FiniteRandomSpout(0, 10));
builder.setSpout(spoutId2, new FiniteRandomSpout(1, 8));
builder.setSpout(spoutId3, new FiniteRandomSpout(2, 13));

builder.setBolt(boltId, new MergerBolt())
	.shuffleGrouping(spoutId1)
	.shuffleGrouping(spoutId2)
	.shuffleGrouping(spoutId3);

builder.setBolt("sink", new BoltPrintSink(new SimpleOutputFormatter()))
	.shuffleGrouping(boltId);
{noformat}

will only print the data from a single source instead of all sources.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)