You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2016/04/29 14:27:12 UTC

[jira] [Commented] (BEAM-103) Make UnboundedSourceWrapper parallel

    [ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263981#comment-15263981 ] 

Aljoscha Krettek commented on BEAM-103:
---------------------------------------

[~mxm] You mentioned once that you already had the code for this? We should move quickly here to make the Flink runner work well with all {{UnboundedSouces}}, especially now that we have {{KafkaIO}}.

> Make UnboundedSourceWrapper parallel
> ------------------------------------
>
>                 Key: BEAM-103
>                 URL: https://issues.apache.org/jira/browse/BEAM-103
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Maximilian Michels
>            Assignee: Kostas Kloudas
>
> As of now {{UnboundedSource}} s are executed with a parallelism of 1 regardless of the splits which the source returns. The corresponding {{UnboundedSourceWrapper}} should implement {{RichParallelSourceFunction}} and deal with splits correctly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)