You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by XuMingmin <gi...@git.apache.org> on 2017/07/12 23:32:27 UTC

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

GitHub user XuMingmin opened a pull request:

    https://github.com/apache/beam/pull/3553

    [BEAM-2610] upgrade to version 2.2.0

    As described in task [BEAM-2610](https://issues.apache.org/jira/browse/BEAM-2610), this is the first PR to do the job. Feel free to merge it if no mis-operation during creating the PR as any issues are supposed to be fixed in the second PR.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/beam master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3553.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3553
    
----
commit 87be64e9817da5e5c86a243471021268d6281b33
Author: Jean-Baptiste Onofré <jb...@apache.org>
Date:   2017-05-12T13:21:49Z

    [BEAM-975] Improve default connection options, javadoc and style in MongoDbIO

commit b400f4a6f06e5d826d35045658c4a383cdd5953b
Author: Jean-Baptiste Onofré <jb...@apache.org>
Date:   2017-06-19T19:24:08Z

    [BEAM-975] This closes #3118

commit 6d27282562911179ea3ff19fd7eae54e8b89425d
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-19T14:43:28Z

    Make HBaseIO tests faster by only using the core daemons needed by HBase

commit c6c8d9ee6b60fcc5d019c41ddab697477704f6d8
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-19T21:23:01Z

    This closes #3392

commit 595ca1ec84134328be5be3c8ae21a5a43a5a7166
Author: Luke Cwik <lc...@google.com>
Date:   2017-06-19T22:48:06Z

    [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268

commit 2304972c5c3b944be0047253687d9cd0004ef21f
Author: Luke Cwik <lc...@google.com>
Date:   2017-06-19T23:05:25Z

    [BEAM-1348] Fix type error introduced into Python SDK because of PR/3268
    
    This closes #3397

commit 1ec59a08a3fab5ac0918d7f1a33b82427957b630
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-05T21:48:38Z

    [BEAM-2411] Make the write transform of HBaseIO simpler

commit d42f6333141e85964d009110d8bea85ad4763632
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-20T08:00:15Z

    [BEAM-2411] Add HBaseCoderProviderRegistrar for better coder inference

commit eae0d05bd7c088accd927dcfe3e511efbb11c9fd
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-20T09:49:25Z

    This closes #3391

commit 6e4357225477d6beb4cb9735255d1759f4fab168
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-19T18:56:29Z

    Retries http code 0 (usually network error)

commit c1a2226c90bed7b7bf68a4cd240c849dc46e55ac
Author: Luke Cwik <lc...@google.com>
Date:   2017-06-20T15:53:59Z

    Retries http code 0 (usually network error)
    
    This closes #3394

commit 5e12e9d75ab78f210b3b024a77c52aaec033218c
Author: jasonkuster <ja...@google.com>
Date:   2017-06-20T19:05:22Z

    Remove notifications from JDK versions test.

commit 0eb4004a8b91760a66585fb486226513686af002
Author: Kenneth Knowles <kl...@google.com>
Date:   2017-06-20T19:39:34Z

    This closes #3403: Remove notifications from JDK versions test.

commit b7ff103f6ee10b07c50ddbd5a49a6a8ce6686087
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-16T21:27:51Z

    Increases backoff in GcsUtil

commit 59598d8f41e65f9a068d7446457395e112dc3bc7
Author: Luke Cwik <lc...@google.com>
Date:   2017-06-20T20:11:06Z

    Increases backoff in GcsUtil
    
    This closes #3381

commit a0523b2dab617d6aee59708a8d8959f42049fce9
Author: Vikas Kedigehalli <vi...@google.com>
Date:   2017-06-19T18:24:14Z

    Fix dataflow runner test to call pipeline.run instead of runner.run

commit f51fdd960cbfbb9ab2b2870606bd0e221d4beceb
Author: chamikara@google.com <ch...@google.com>
Date:   2017-06-20T20:32:49Z

    This closes #3393

commit 08ec0d4dbff330ecd48c806cd764ab5a96835bd9
Author: Robert Bradshaw <ro...@gmail.com>
Date:   2017-06-20T18:01:03Z

    Port fn_api_runner to be able to use runner protos.

commit e4ef23e16859e31e09e5fe6cf861d6f3db816b22
Author: Robert Bradshaw <ro...@gmail.com>
Date:   2017-06-20T20:47:31Z

    Closes #3361

commit f69e3b53fafa4b79b21095d4b65edbe7cfeb7d2a
Author: Pei He <pe...@apache.org>
Date:   2017-06-19T22:55:48Z

    FlinkRunner: remove the unused ReflectiveOneToOneOverrideFactory.

commit 52794096aa8b4d614423fd787835f5b89b1ea1ac
Author: Pei He <pe...@apache.org>
Date:   2017-06-19T23:10:02Z

    Flink runner: refactor the translator into two phases: rewriting and translating.

commit 608a9c4590ebd94e53ee1ec7f3ad60bfb4905c11
Author: Pei He <pe...@apache.org>
Date:   2017-06-20T21:12:55Z

    This closes #3275

commit 42a2de91adf1387bb8eaf9aa515a24f6f276bf40
Author: Mairbek Khadikov <ma...@google.com>
Date:   2017-06-14T20:03:36Z

    Support ValueProviders in SpannerIO.Write

commit 10e47646dd5f20d4049d670249cae56c51768ae0
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-20T21:25:56Z

    This closes #3358: [BEAM-1542] Support ValueProviders in SpannerIO

commit 69b01a6118702277348d2f625af669225c9ed99e
Author: Reuven Lax <re...@google.com>
Date:   2017-05-13T19:53:08Z

    Add spilling code to WriteFiles.

commit 698b89e2b5b88403a5c762b039d3ec8c48b25b26
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-20T21:28:39Z

    This closes #3161: [BEAM-2302] Add spilling code to WriteFiles.

commit a06c8bfae6fb9e35deeb4adfdd7761889b12be89
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-02-02T01:26:55Z

    [BEAM-1377] Splittable DoFn in Dataflow streaming runner
    
    Transform expansion and translation for the involved primitive
    transforms. Of course, the current PR will only work after the
    respective Dataflow worker and backend changes are released.

commit 4f6032c9c1774a9797e3ff25cc2a05fe56453f21
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-19T15:34:31Z

    Bump Dataflow worker to 20170619

commit fd40d4b29d3e46dfe25bd7cea65eb7b51dde135f
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-20T23:27:26Z

    This closes #1898: [BEAM-1377] Splittable DoFn in Dataflow streaming runner

commit ef19024d2e9dc046c6699aeee1edc483beb9a009
Author: Ahmet Altay <al...@google.com>
Date:   2017-06-20T21:25:55Z

    Add a cloud-pubsub dependency to the list of gcp extra packages

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

Posted by XuMingmin <gi...@git.apache.org>.
Github user XuMingmin closed the pull request at:

    https://github.com/apache/beam/pull/3553


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

Posted by XuMingmin <gi...@git.apache.org>.
GitHub user XuMingmin reopened a pull request:

    https://github.com/apache/beam/pull/3553

    [BEAM-2610] upgrade to version 2.2.0

    As described in task [BEAM-2610](https://issues.apache.org/jira/browse/BEAM-2610), this is the first PR to do the job. Feel free to merge it if no mis-operation during creating the PR as any issues are supposed to be fixed in the second PR.
    
    Btw, the failure is expected as dsl/sql is still using `2.1.0-SNAPSHOT`, and be fixed in PR 2

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/apache/beam master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3553.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3553
    
----
commit eae0d05bd7c088accd927dcfe3e511efbb11c9fd
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-20T09:49:25Z

    This closes #3391

commit 6e4357225477d6beb4cb9735255d1759f4fab168
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-19T18:56:29Z

    Retries http code 0 (usually network error)

commit c1a2226c90bed7b7bf68a4cd240c849dc46e55ac
Author: Luke Cwik <lc...@google.com>
Date:   2017-06-20T15:53:59Z

    Retries http code 0 (usually network error)
    
    This closes #3394

commit 5e12e9d75ab78f210b3b024a77c52aaec033218c
Author: jasonkuster <ja...@google.com>
Date:   2017-06-20T19:05:22Z

    Remove notifications from JDK versions test.

commit 0eb4004a8b91760a66585fb486226513686af002
Author: Kenneth Knowles <kl...@google.com>
Date:   2017-06-20T19:39:34Z

    This closes #3403: Remove notifications from JDK versions test.

commit b7ff103f6ee10b07c50ddbd5a49a6a8ce6686087
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-16T21:27:51Z

    Increases backoff in GcsUtil

commit 59598d8f41e65f9a068d7446457395e112dc3bc7
Author: Luke Cwik <lc...@google.com>
Date:   2017-06-20T20:11:06Z

    Increases backoff in GcsUtil
    
    This closes #3381

commit a0523b2dab617d6aee59708a8d8959f42049fce9
Author: Vikas Kedigehalli <vi...@google.com>
Date:   2017-06-19T18:24:14Z

    Fix dataflow runner test to call pipeline.run instead of runner.run

commit f51fdd960cbfbb9ab2b2870606bd0e221d4beceb
Author: chamikara@google.com <ch...@google.com>
Date:   2017-06-20T20:32:49Z

    This closes #3393

commit 08ec0d4dbff330ecd48c806cd764ab5a96835bd9
Author: Robert Bradshaw <ro...@gmail.com>
Date:   2017-06-20T18:01:03Z

    Port fn_api_runner to be able to use runner protos.

commit e4ef23e16859e31e09e5fe6cf861d6f3db816b22
Author: Robert Bradshaw <ro...@gmail.com>
Date:   2017-06-20T20:47:31Z

    Closes #3361

commit f69e3b53fafa4b79b21095d4b65edbe7cfeb7d2a
Author: Pei He <pe...@apache.org>
Date:   2017-06-19T22:55:48Z

    FlinkRunner: remove the unused ReflectiveOneToOneOverrideFactory.

commit 52794096aa8b4d614423fd787835f5b89b1ea1ac
Author: Pei He <pe...@apache.org>
Date:   2017-06-19T23:10:02Z

    Flink runner: refactor the translator into two phases: rewriting and translating.

commit 608a9c4590ebd94e53ee1ec7f3ad60bfb4905c11
Author: Pei He <pe...@apache.org>
Date:   2017-06-20T21:12:55Z

    This closes #3275

commit 42a2de91adf1387bb8eaf9aa515a24f6f276bf40
Author: Mairbek Khadikov <ma...@google.com>
Date:   2017-06-14T20:03:36Z

    Support ValueProviders in SpannerIO.Write

commit 10e47646dd5f20d4049d670249cae56c51768ae0
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-20T21:25:56Z

    This closes #3358: [BEAM-1542] Support ValueProviders in SpannerIO

commit 69b01a6118702277348d2f625af669225c9ed99e
Author: Reuven Lax <re...@google.com>
Date:   2017-05-13T19:53:08Z

    Add spilling code to WriteFiles.

commit 698b89e2b5b88403a5c762b039d3ec8c48b25b26
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-20T21:28:39Z

    This closes #3161: [BEAM-2302] Add spilling code to WriteFiles.

commit a06c8bfae6fb9e35deeb4adfdd7761889b12be89
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-02-02T01:26:55Z

    [BEAM-1377] Splittable DoFn in Dataflow streaming runner
    
    Transform expansion and translation for the involved primitive
    transforms. Of course, the current PR will only work after the
    respective Dataflow worker and backend changes are released.

commit 4f6032c9c1774a9797e3ff25cc2a05fe56453f21
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-19T15:34:31Z

    Bump Dataflow worker to 20170619

commit fd40d4b29d3e46dfe25bd7cea65eb7b51dde135f
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-20T23:27:26Z

    This closes #1898: [BEAM-1377] Splittable DoFn in Dataflow streaming runner

commit ef19024d2e9dc046c6699aeee1edc483beb9a009
Author: Ahmet Altay <al...@google.com>
Date:   2017-06-20T21:25:55Z

    Add a cloud-pubsub dependency to the list of gcp extra packages

commit 223dbb4498938763283d52407331a7bc11bbc77c
Author: Ahmet Altay <al...@google.com>
Date:   2017-06-20T23:43:19Z

    This closes #3404

commit cbb922c8a72680c5b8b4299197b515abf650bfdf
Author: Reuven Lax <re...@google.com>
Date:   2017-02-08T20:53:27Z

    BEAM-1438 Auto shard streaming sinks
    
    If a Write operation in streaming requests runner-determined sharding,
    make the Dataflow runner default to maxNumWorkers * 2 shards.

commit 7b4f5eeaa273bc22beba18a62006ead8bc096d50
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-06-21T00:42:52Z

    This closes #1952: BEAM-1438 Auto shard streaming sinks

commit 5a95d620ad0c7f427a5b849059a0215c3f061a58
Author: Sourabh Bajaj <so...@google.com>
Date:   2017-06-21T01:53:50Z

    None should be a valid return element

commit a40d11c8e6f9a364105972eeaaa6591711471be9
Author: Robert Bradshaw <ro...@gmail.com>
Date:   2017-06-21T03:34:05Z

    Closes #3408

commit 6b6d20d9dc5afa0c1d8520cf6dbc98e6488a58a2
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-20T23:04:18Z

    Return a valid Coder for any subtype of Mutation on HBaseCoderProviderRegistrar

commit f96a127e2969d27bb3f02695da498fec3b96bbe8
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-21T07:07:44Z

    This closes #3407

commit 6681472a2aa277ba83fd9e2ffec5a57c46d5820c
Author: Ismaël Mejía <ie...@apache.org>
Date:   2017-06-20T12:13:00Z

    [BEAM-2481] Update commons-lang3 dependency to version 3.6

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

Posted by XuMingmin <gi...@git.apache.org>.
Github user XuMingmin closed the pull request at:

    https://github.com/apache/beam/pull/3553


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---