[jira] [Commented] (BEAM-103) Make UnboundedSourceWrapper parallel

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268736#comment-15268736 ] 

ASF GitHub Bot commented on BEAM-103:
-------------------------------------

GitHub user aljoscha opened a pull request:

    https://github.com/apache/incubator-beam/pull/274

    [BEAM-103][BEAM-130] Make Flink Source Parallel and Checkpointed

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [x ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [x ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ x] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one
    ---
    
    CC: @mxm for the Flink parts
    CC: @tgroh for the tests, I thought you could have something to say about that since you started the doc about better testing
    
    I created a new `TestCountingSource` in the `runner-flink` package because I didn't want to depend on the data flow runner. Maybe we should move this to a common package.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/aljoscha/incubator-beam flink-parallel-unbounded-source

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/274.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #274
    
----
commit 698f50bd7759e3a036e35ca214b1d727f9db4e51
Author: Aljoscha Krettek <al...@gmail.com>
Date:   2016-05-03T11:35:35Z

    [BEAM-103][BEAM-130] Make Flink Source Parallel and Checkpointed

----


> Make UnboundedSourceWrapper parallel
> ------------------------------------
>
>                 Key: BEAM-103
>                 URL: https://issues.apache.org/jira/browse/BEAM-103
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-flink
>            Reporter: Maximilian Michels
>            Assignee: Aljoscha Krettek
>
> As of now {{UnboundedSource}} s are executed with a parallelism of 1 regardless of the splits which the source returns. The corresponding {{UnboundedSourceWrapper}} should implement {{RichParallelSourceFunction}} and deal with splits correctly.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)