[GitHub] beam pull request #2610: Merge master into gearpump-runner branch

[manuzhang <gi...@git.apache.org>]

GitHub user manuzhang opened a pull request:

    https://github.com/apache/beam/pull/2610

    Merge master into gearpump-runner branch

    Be sure to do all of the following to help us incorporate your contribution
    quickly and easily:
    
     - [ ] Make sure the PR title is formatted like:
       `[BEAM-<Jira issue #>] Description of pull request`
     - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
           Travis-CI on your fork and ensure the whole test matrix passes).
     - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue
           number, if there is one.
     - [ ] If this contribution is large, please file an Apache
           [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
    
    ---


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/manuzhang/incubator-beam merge_master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/2610.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2610
    
----
commit e0e39a97560933f99eaee98549877fd5f8f49a52
Author: Dan Halperin <dh...@google.com>
Date:   2017-04-10T17:16:06Z

    This closes #2481

commit a3a15a5370467db72f8be2fa031483349e49f6ab
Author: Ahmet Altay <al...@google.com>
Date:   2017-04-08T00:54:14Z

    enable test_multi_valued_singleton_side_input test

commit 80d2548f258074931a62e412609363dfd2305086
Author: Ahmet Altay <al...@google.com>
Date:   2017-04-10T17:49:16Z

    This closes #2467

commit 74e31c350986d093be1a0b53d001b3376def8b69
Author: Thomas Weise <th...@apache.org>
Date:   2017-04-08T20:01:01Z

    BEAM-1053 ApexGroupByKeyOperator serialization issues

commit 836e8e4aab239dd41f81de2f1553850b3fd3d716
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-04-10T17:55:50Z

    This closes #2473

commit 33d4a02bb28e5a1c09513dc3e7701b30df148943
Author: Vikas Kedigehalli <vi...@google.com>
Date:   2017-04-03T17:01:45Z

    Create as custom source

commit fc1006500d14afd01a3a34527c0ea9dc94ac09e9
Author: Chamikara Jayalath <ch...@google.com>
Date:   2017-04-10T21:18:30Z

    This closes #2446

commit b7d7adc879694cf5b22f80a26a46982730a483ec
Author: Thomas Groh <tg...@google.com>
Date:   2017-04-07T16:17:19Z

    Add SdkComponents
    
    This takes SDK objects and assigns IDs to them. It is effectively a
    ComponentsBuilder context where a component is referred to by the
    Java object which is being translated, rather than by an opaque
    string or protocol buffer.

commit 8afa62398d51e3b11215970b139ab839ccb2e91a
Author: Thomas Groh <tg...@google.com>
Date:   2017-04-10T22:14:34Z

    This closes #2459

commit 11a3af8474998bd2b874cfeede82f353999ae3e3
Author: Ahmet Altay <al...@google.com>
Date:   2017-04-10T21:13:00Z

    Upgrade dependencies.
    
    Minor version changes to use latest versions of
    avro, pyyaml, google-apitools, googledatastore.

commit 1c7a974ab00b8f4a8c089520aeb15ec29e128977
Author: Ahmet Altay <al...@google.com>
Date:   2017-04-10T22:18:37Z

    This closes #2484

commit 678833096550cf81da0fe026ab978626e395ef11
Author: Maria Garcia Herrero <ma...@google.com>
Date:   2017-04-09T06:08:44Z

    Skip query metrics when creating a template

commit 1761d1cabf47e34fd9107c5673339aa966148f0e
Author: Ahmet Altay <al...@google.com>
Date:   2017-04-10T22:23:21Z

    This closes #2475

commit 9e453fabe2bf448552ab5706130495e5ea4cf1c2
Author: Vikas Kedigehalli <vi...@google.com>
Date:   2017-04-08T02:22:27Z

    Fix GroupByKeyInputVisitor for Direct Runner

commit 7fd9c6516e2222a5f3d290fd95507559b0c99940
Author: Ahmet Altay <al...@google.com>
Date:   2017-04-10T22:28:12Z

    This closes #2470

commit 40b36686bac65995d606fe5cea7aa957d0ef3f9d
Author: Thomas Groh <tg...@google.com>
Date:   2017-04-10T21:35:59Z

    Move WindowingStrategies to runners-core-construction

commit 0a0b1c80c97949954add4b4357fe29409a08197d
Author: Thomas Groh <tg...@google.com>
Date:   2017-04-11T02:24:52Z

    This closes #2486

commit 62e23b71e3b964033c15707629b560dfc8204654
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-04-08T00:54:18Z

    Removes DoFn.ProcessContinuation completely

commit 159ac58122258e42b8faa94dad20e9fb82a4fe34
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-04-10T22:44:14Z

    Bump Dataflow worker to 20170410

commit c58f4f89b3026e130b63dc14731a8ee8615e92f5
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-04-11T05:51:54Z

    This closes #2468

commit 5f7c772cc4d21b220fa3b5dcec8b7d5bdba8685f
Author: Dan Halperin <dh...@google.com>
Date:   2017-04-07T21:50:42Z

    PubsubIO: remove support for BoundedReader
    
    Google Cloud Pub/Sub is not currently that useful in bounded mode --
    it's a streaming source. Years ago, before the DirectRunner supported
    unbounded PCollections and sources, however, we were unable to run the
    streaming source in any SDK -- so we added a trivial bounded mode for
    testing.
    
    That trivial mode is no longer necessary. Additionally, it may confuse
    users into thinking it's reliable (it's not), performant (it's not),
    or has well defined semantics (it doesn't) -- it's really intended just
    for testing.
    
    Now that the DirectRunner supports everything we need -- unbounded
    PCollections, non-blocking execution with cancelation, etc. -- we can
    delete the bounded mode.

commit 84a96297c4f790249890cd41775472240181cb62
Author: Dan Halperin <dh...@google.com>
Date:   2017-04-11T12:11:44Z

    This closes #2471

commit b615013b9c941038d3e9fd96a153f0894f52f183
Author: Stephen Sisk <si...@google.com>
Date:   2017-04-07T19:59:28Z

    Move HashingFn to io/common, switch to better hash

commit c46b256d7dbde1cfde311994faed31e78f143957
Author: Dan Halperin <dh...@google.com>
Date:   2017-04-11T15:15:51Z

    This closes #2463

commit 17733e375ec057678d947076e2e83d955d8f8440
Author: Dan Halperin <dh...@google.com>
Date:   2017-04-11T12:59:25Z

    Flip dependency edge between Dataflow runner and IO-GCP
    
    This will stop integration tests from running.

commit 986fcefcad1e48be951babf8a8ce4aeeaece07e3
Author: Isma�l Mej�a <ie...@apache.org>
Date:   2017-04-11T15:16:37Z

    This closes #2489

commit 01e5a8d5c7517f511d5d7bfc524319a02e6d2e21
Author: Thomas Groh <tg...@google.com>
Date:   2017-04-07T18:46:24Z

    Add Coder utilities for Proto conversions
    
    Include Known Coders

commit 8beea73c1b57414dfb2b0a3f44f5bee29f088b4e
Author: Thomas Groh <tg...@google.com>
Date:   2017-04-11T16:58:44Z

    This closes #2487

commit c08b7b1771481b77c94ec78a96db5b34fec29841
Author: Dipti Kulkarni <di...@persistent.co.in>
Date:   2017-04-10T10:13:12Z

    Improve HadoopInputFormatIO DisplayData and Cassandra tests

commit d255fa25f1a1a0bf61ea159e2922f014d36eda43
Author: Dan Halperin <dh...@google.com>
Date:   2017-04-11T17:20:35Z

    This closes #2460

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] beam pull request #2610: Merge master into gearpump-runner branch

[asfgit <gi...@git.apache.org>]

Github user asfgit closed the pull request at:

    https://github.com/apache/beam/pull/2610


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---