[GitHub] incubator-beam pull request #1193: sync gearpump-runner branch with master

[manuzhang <gi...@git.apache.org>]

GitHub user manuzhang opened a pull request:

    https://github.com/apache/incubator-beam/pull/1193

    sync gearpump-runner branch with master

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
    
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/manuzhang/incubator-beam gearpump-runner

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/1193.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1193
    
----
commit 60a8aef713925e643cf9ec2bcb5c0b518aaa49e0
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-04T20:23:17Z

    De-pluralize error message expectation in LatestFnTests

commit 52e43ac7b8257ecbcda61eb3b14406c36df08a3b
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-04T20:23:37Z

    Move LatestFnTests to LatestFnTest

commit f554398bc09df194409fd0dd3577f7e800b709cc
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-04T22:09:54Z

    Forbid files ending in Tests.java as they should end in Test.java

commit f5aa6eb73cb475714dc5d7b1b959329023fa5672
Author: Mark Liu <ma...@markliu-macbookpro.roam.corp.google.com>
Date:   2016-10-06T00:50:05Z

    Fix Precommit Integration Test Failure

commit 0ddba6d8d2e2d9ea9586615e5ed0d495f12086e5
Author: Luke Cwik <lc...@google.com>
Date:   2016-10-06T17:55:57Z

    Fix Streaming Integration Test Failure in Precommit
    
    This closes #1059

commit 7306e16b7c92b16fac4491dcc07e6b45cd7fff62
Author: Thomas Groh <tg...@google.com>
Date:   2016-09-30T23:28:35Z

    Add RootTransformEvaluatorFactory
    
    Use for Root Transforms.
    
    These transforms generate their own initial inputs, which the Evaluator
    is responsible for providing back to them to generate elements from the
    root PCollections.
    
    Update ExecutorServiceParallelExecutor to schedule roots based on the
    provided transforms.

commit 41fb16f014a79d2b9c149c5b369db12b61c4c774
Author: Thomas Groh <tg...@google.com>
Date:   2016-10-05T20:12:48Z

    Remove KeyedResourcePool
    
    This interface is no longer used. Instead, the runner ensures that
    bundles will be provided containing the appropriate input to the
    TestStreamEvaluatorFactory.

commit ecbc64117e3bb4e1be35a7539463e62e1a3ba303
Author: Luke Cwik <lc...@google.com>
Date:   2016-10-06T22:15:12Z

    [BEAM-310] Add RootTransformEvaluatorFactory
    
    This closes #1051

commit cca861ba82a2e6ba6c6af122be0b8a9932d53cc5
Author: Pei He <pe...@google.com>
Date:   2016-10-04T02:37:02Z

    Forward port Dataflow PR-431 to Beam

commit 0ac0caf2f78064a820f8a6ae23624162dcd1419f
Author: Pei He <pe...@google.com>
Date:   2016-10-04T03:39:32Z

    Forward port Dataflow PR-454 to Beam

commit 9f33e8692fe4852b1825c5464eafa8d9e9786425
Author: Pei He <pe...@google.com>
Date:   2016-10-04T04:05:44Z

    Forward port Dataflow PR-453 to Beam

commit 9b71f1636fe6dc99528c18a6b7c47247c5456caa
Author: Luke Cwik <lc...@google.com>
Date:   2016-10-06T22:33:28Z

    Forward port Dataflow PR-431, PR-454, PR-453 to Beam
    
    This closes #1039

commit e2a24f3c2668c7341b38cc56d331cefd3a69f27f
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-04T20:56:13Z

    Add DoFnInvoker for OldDoFn, for migration ease
    
    This allows any runner to use DoFnInvokers.invokerFor(Object) to be
    agnostic as to whether they are running a DoFn or OldDoFn. Thus,
    the migration of the runner can occur in advance of further changes
    to the SDK and deployment can be independent. For example, a backend
    need not know whether it is deserializing a DoFn or OldDoFn.

commit 03b89c065aa7a0a6d86aeb105dc9164f071e28a5
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-07T03:18:33Z

    This closes #1049

commit e3e6fe3fc4cf462f84271acc8447798760ae770f
Author: Eugene Kirpichov <ki...@google.com>
Date:   2016-09-29T21:00:41Z

    Improve compile-time type checking
    
    * Enables -Xlint:rawtypes except for Spark and Flink runners and the
      microbenchmarks module
    
    * Fixed some warnings in tests
    
    * Fixed checkstyle warnings

commit 2492604e4becac4dde67b84083be68d2d509da2e
Author: Dan Halperin <dh...@google.com>
Date:   2016-10-07T16:50:20Z

    Closes #1028

commit da57ae814bdc9c8d0661c27906f4a6e3c9e7474f
Author: Thomas Groh <tg...@google.com>
Date:   2016-10-07T22:50:05Z

    Only remove Elements that were pending from Pending Elements
    
    Update the comparator so elements will only be removed from the
    collection of pending elements if they were formerly added. This ensures
    that elements cannot be removed if a timer delivery has an identical
    timestamp to them.

commit 39b9de5feab7be37f88e44e99784375a8ae82bc7
Author: Pei He <pe...@google.com>
Date:   2016-10-04T04:19:37Z

    BigQueryIO: port trivial fixes from Dataflow version.

commit 570de74da05082f1a97b54191356f13c7fea5657
Author: Luke Cwik <lc...@google.com>
Date:   2016-10-10T16:02:08Z

    BigQueryIO: port trivial fixes from Dataflow version.
    
    This closes #1042

commit a37ec0ae9d07915fe33e932578628b02b3161d02
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-10T18:28:11Z

    Move GcsPathValidatorTest to package matching class under test

commit c7c13157fae00a0af6bcc3aad2369c34956507ed
Author: Luke Cwik <lc...@google.com>
Date:   2016-10-10T18:49:28Z

    Move GcsPathValidatorTest to package matching class under test
    
    This closes #1074

commit 1d3f31da7ee9769200e8a93ec3626cd4cd636f67
Author: Pei He <pe...@google.com>
Date:   2016-10-10T21:30:30Z

    [BEAM-736] Fix BigQueryTornadoesIT, broken by PR-1039

commit daf69f87e7271b2620e9bc023a8a360a485f856a
Author: Luke Cwik <lc...@google.com>
Date:   2016-10-11T00:28:52Z

    [BEAM-736] Fix BigQueryTornadoesIT, broken by PR-1039
    
    This closes #1078

commit 89cfee06f310c8137c3822d0096eadd359f5b8a2
Author: Jean-Baptiste Onofr� <jb...@apache.org>
Date:   2016-10-10T19:15:04Z

    Define DataSourceConfiguration as public in JdbcIO

commit 6c8821682f45f4361392c9da0756076ec5d0966f
Author: Jean-Baptiste Onofr� <jb...@apache.org>
Date:   2016-10-11T06:35:39Z

    This closes #1075

commit 8017a02597e260dd9e3306fba5165385e078c645
Author: manuzhang <ow...@gmail.com>
Date:   2016-10-10T11:38:35Z

    [BEAM-740] improve runners-flink README.md

commit 1de6439f14f3a1716427f10606d89a29413367d9
Author: Jean-Baptiste Onofr� <jb...@apache.org>
Date:   2016-10-11T07:57:57Z

    [BEAM-740] This closes #1082

commit e195237df4607b5e92dbced7bde32ad526f1b63e
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-10T21:59:54Z

    Remove unused ListOutputManager

commit 48a7a55843115be55158cfce4663506bcab3f82a
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-10T22:01:41Z

    Inline DoFnRunnerBase to its sole subclass

commit bac00e1a4e0bd7a223f4645e438848c22b830ce1
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-10T22:04:42Z

    Fix access levels on SimpleDoFnRunner

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request #1193: [BEAM-79] sync gearpump-runner branch wit...

[asfgit <gi...@git.apache.org>]

Github user asfgit closed the pull request at:

    https://github.com/apache/incubator-beam/pull/1193


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---