You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/03/23 16:41:25 UTC
[jira] [Commented] (BEAM-143) Add test for UnboundedSourceWrapper

    [ https://issues.apache.org/jira/browse/BEAM-143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208614#comment-15208614 ] 

ASF GitHub Bot commented on BEAM-143:
-------------------------------------

GitHub user mxm opened a pull request:

    https://github.com/apache/incubator-beam/pull/69

    [BEAM-143] add test for UnboundedSourceWrapper

    So far the `UnboundedSourceWrapper` has not been tested systematically which led to a bunch of regression issues. This PR fixes the UnboundedSourceWrapper and adds a test case. The test case ensures that the wrapper works as expected. In particular, a full integration test is run to check whether serialization and instantiation of the wrapper works in a cluster setup.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/mxm/incubator-beam BEAM-143

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/69.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #69
    
----
commit 8d36d5dcd55b827f23a22f8acdff455a9c21ffa5
Author: Thomas Groh <tg...@google.com>
Date:   2016-03-07T21:47:30Z

    Filter Synthetic Methods in PipelineOptionsFactory

commit 25409464a27b1cbb7adffe90aa7e49e3b1bce4cb
Author: Thomas Groh <tg...@google.com>
Date:   2016-02-27T01:30:13Z

    Implement InProcessPipelineRunner#run
    
    Appropriately construct an evaluation context and executor, and start
    the pipeline when run is called.
    
    Implement InProcessPipelineResult.
    
    Apply PTransform overrides.

commit 4c21708c574d5d08db6c7bac5fca1ce09780b730
Author: Rafal Wojdyla <ra...@spotify.com>
Date:   2016-03-11T18:39:55Z

    [flink] Add FlinkRunnerRegistrar
    
    Expose Flink runner and options via AuteService. AuteService will
    at compile time populate META-INF/services so that Dataflow sdk
    can seamlessly pick up FlinkRunner.
    
    This closes #40.

commit cb3081da383e6de88a04fd5e190ef69849e1f586
Author: Maximilian Michels <mx...@apache.org>
Date:   2016-03-16T11:03:07Z

    [BEAM-116] change runners artifactId to runners-parent

commit 066e6ce518be869b424aa283967956de8cb0c495
Author: Scott Wegner <sw...@google.com>
Date:   2016-03-17T17:22:42Z

    Add DisplayData builder API to SDK
    
    This allows generating the display data which will be attached to
    PTransforms.

commit 28e13f2ae73941404ade8ca2c3e64af43fefc85d
Author: Maximilian Michels <mx...@apache.org>
Date:   2016-03-21T10:36:35Z

    [flink] add test case for Runner registration

commit d1fcc6645837998176dffbc61464046ec17dbb1f
Author: sammcveety <sa...@gmail.com>
Date:   2016-03-22T18:58:19Z

    Update AutoComplete.java
    
    Allow for the Datastore dependency of this test to be in a different project than the main project for the job.

commit 63a2d5447b050b2a7e9e8201ec7bcc287849420e
Author: Neville Li <ne...@spotify.com>
Date:   2016-03-22T22:05:51Z

    make BigtableIO#Read#withRowFilter public

commit 73bbb1c523548b34a8b8403785c68094a5995a51
Author: Maximilian Michels <mx...@apache.org>
Date:   2016-03-23T15:18:04Z

    [BEAM-144] solve reader serialization issue
    
    Now, we initialize the UnboundedSourceReader at runtime which requires
    us to keep a copy of the PipelineOptions. This should be fine here
    because we are at the lowest point of the execution stack.

commit f491b424483d7c21f4fdc7b21f489762d0ef964b
Author: Maximilian Michels <mx...@apache.org>
Date:   2016-03-23T15:19:27Z

    [BEAM-143] [flink] add test for UnboundedSourceWrapper
    
    The test ensures serialization and execution of the wrapper works as
    expected.

----


> Add test for UnboundedSourceWrapper
> -----------------------------------
>
>                 Key: BEAM-143
>                 URL: https://issues.apache.org/jira/browse/BEAM-143
>             Project: Beam
>          Issue Type: Test
>          Components: runner-flink
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>
> A test case should ensure the wrapper works as expected. In particular, a full integration test should be run to check whether serialization and instantiation of the wrapper works in a cluster setup.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)