[GitHub] incubator-beam pull request #1306: sync gearpump-runner with master

[manuzhang <gi...@git.apache.org>]

GitHub user manuzhang opened a pull request:

    https://github.com/apache/incubator-beam/pull/1306

    sync gearpump-runner with master

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt).
    
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/manuzhang/incubator-beam gearpump-runner-sync

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-beam/pull/1306.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #1306
    
----
commit a54ded373fa7f6508fb46eea1a1d6f9bc405114b
Author: Sela <an...@paypal.com>
Date:   2016-10-22T11:51:50Z

    [BEAM-799] Support GroupByKey directly.
    
    Remove runner override for GroupByKey.
    
    Avoid NPE if no sideInputs are available in reader.
    
    Handle CombineFn with or without context.

commit 53fe3ee425163a76b69d0830449d222d925eb9cd
Author: Sela <an...@paypal.com>
Date:   2016-10-26T07:01:51Z

    This closes #1162

commit 13b83858746356068a6d618e04da6839e837d28c
Author: Sela <an...@paypal.com>
Date:   2016-10-24T19:35:39Z

    [BEAM-809] Create a KryoRegistrator for the SparkRunner.
    
    Use Class#getName() instead of canonicalName().

commit 78e2c038766063081a8c045607c74ad158afdf68
Author: Sela <an...@paypal.com>
Date:   2016-10-26T15:54:09Z

    This closes #1171

commit 3c71e4da3490c599436d71ac344354c5fa8b693f
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-25T02:31:26Z

    Revert "Fix invalid snapshot repo in Travis CI's maven settings.xml"
    
    This reverts commit fbc23ed9234088c9d88bf88b19a3a4d6d5e52446.

commit 3af2c1e7336d4856cc80827d39f244eb4b1ceadc
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-25T02:34:04Z

    Set up Maven settings globally for Travis CI builds

commit 7091a0120e070335c24198d5f297a9fcff25fe75
Author: Dan Halperin <dh...@google.com>
Date:   2016-10-26T17:13:59Z

    Closes #1180

commit 35244a680d53ddca4733dbef5b2570e6f78140d6
Author: sammcveety <sa...@gmail.com>
Date:   2016-10-14T17:06:08Z

    Add utility to handle JSON option manipulation

commit c94b8eacd480c3b49ae07ff117c2201079150dec
Author: Dan Halperin <dh...@google.com>
Date:   2016-10-26T17:20:22Z

    Closes #1105

commit b72e7e34f70527e4ee575aaf0bc8c4c31ed31b0a
Author: Sela <an...@paypal.com>
Date:   2016-09-29T13:30:32Z

    [BEAM-658] Support Read.Unbounded primitive.
    
    Changed mapSourceFunction to use scala's native Option.
    
    Upgrade to kryo-serializers 0.39 that provides support for ReverseList (used by Top).
    
    Better logging.
    
    Allow a longer read time-frame for read in tests.
    
    Assert initial parallelism is gerater than zero.
    
    Add OnBatchCompleted listener that writes to Kafka.
    
    Test latest.
    
    Give read from Kafka more time to avoid flaky tests.
    
    Change log level in MicrobatchSource.Reader to debug.

commit dc61a001c1b9389450ade3f49b98a9a22c10f794
Author: Sela <an...@paypal.com>
Date:   2016-10-26T17:52:17Z

    This closes #1143

commit 6db942498a6aa20e9fd253871320d0ee4aa9476d
Author: Stas Levin <st...@gmail.com>
Date:   2016-10-25T15:23:23Z

    [BEAM-816] Aggregators are not properly named when reported to Graphite.
    
    Added NamedAggregatorTest.

commit 9f30b21a7b36f73685934746560cd3e02ab451e7
Author: Sela <an...@paypal.com>
Date:   2016-10-26T18:17:12Z

    This closes #1185

commit c88953388d2f53e1f67ab10fb22d8ab8808980ff
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-26T20:03:45Z

    Add default version for beam-sdks-java-io-kafka

commit 9d6598d30e097e4a848bb0488271d196cc51d078
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-26T20:04:24Z

    Use project-wise version in SparkRunner dep on KafkaIO

commit f9e07cfb2970ceb7e6ace8393eb947ad5efa34c9
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-26T20:33:03Z

    This closes #1195

commit 5c558e6f6b0fe63324de7400121f33a91418fc02
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-26T17:37:09Z

    Streamline Travis CI build

commit 09a80ecb4a464f63b6f65fbdba7783920280efb3
Author: Dan Halperin <dh...@google.com>
Date:   2016-10-26T21:44:22Z

    Closes #1181

commit 1559a7f40fb96d3c22de93391792a298f9a84480
Author: Pei He <pe...@google.com>
Date:   2016-10-22T00:38:21Z

    Remove checked exceptions from PipelineResult.waitUntilFinish interface.

commit 48fdd06760ded8bb2010b12fad430068a06bdec6
Author: Dan Halperin <dh...@google.com>
Date:   2016-10-26T21:47:10Z

    Closes #1160

commit 3bec5e03fc21c33080bb31488a849aae0a7ce9ef
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-24T20:28:06Z

    Port some example utils from OldDoFn to DoFn

commit 25102f798cf8ddc2a706c3932e856a7825555dc5
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-26T21:59:14Z

    This closes #1173

commit eba099f564dba3dfbba30ae3533496b9e14f57a7
Author: Neville Li <ne...@spotify.com>
Date:   2016-10-24T22:56:36Z

    [BEAM-813] support metadata in Avro sink

commit e5afbe560b604ae7081e420af5b0d855508d53ad
Author: Pei He <pe...@google.com>
Date:   2016-10-13T21:44:13Z

    [BEAM-443] Update Beam batch examples to call waitUntilFinish()

commit ee6ad2fe416cd499aa1b6e2a51aa64da0805cc5c
Author: Dan Halperin <dh...@google.com>
Date:   2016-10-27T17:35:13Z

    Closes #1097

commit 73db5608a58ff64a0b452140736a150f973986b8
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-24T22:11:12Z

    Make DoFnInfo carry OldDoFn or DoFn
    
    This will allow consumers to prepare to accept
    DoFn while still accepting existing jobs that
    use OldDoFn. It is a move towards treating
    the Fn itself as just a serialized blob.

commit 95bf7a835d81a7b62b734362386e0aea64a42532
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-26T21:45:54Z

    Update Dataflow worker image pointer

commit 064f18a8f704ba4713701b7c8432a6f9b401a110
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-27T17:48:35Z

    This closes #1176

commit 34a236cead89ec72fded2cf44e6e1b0b540838d3
Author: Thomas Groh <tg...@google.com>
Date:   2016-10-26T21:31:41Z

    Use a Constant TupleTag in GroupAlsoByWindowEvaluator
    
    This avoids the cost of generating a random ID, which is moderately
    expensive.

commit 4cb1d10dfb49c7a0622bfe8ec7b5524295ef6da1
Author: Kenneth Knowles <kl...@google.com>
Date:   2016-10-27T19:50:08Z

    This closes #1196

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request #1306: [BEAM-79] sync gearpump-runner with maste...

[asfgit <gi...@git.apache.org>]

Github user asfgit closed the pull request at:

    https://github.com/apache/incubator-beam/pull/1306


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---