You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by bschell <gi...@git.apache.org> on 2017/08/02 22:34:15 UTC
[GitHub] beam pull request #3677: Tez runner

GitHub user bschell opened a pull request:

    https://github.com/apache/beam/pull/3677

    Tez runner

    Adding a TezRunner.
    Intended to be merged to a feature branch for continued work.


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/bschell/beam TezRunner

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/beam/pull/3677.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #3677
    
----
commit 56262d8f3064031606e01801eb36322cb3a38b95
Author: Davor Bonaci <da...@google.com>
Date:   2017-05-05T22:53:46Z

    Update version number from 0.7.0-SNAPSHOT to 2.0.0-SNAPSHOT

commit 1a77e208e440ef34b7d0f7e1104d5c8c5ee04474
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-05T23:32:54Z

    This cherry-picks #2926

commit b9c8cfe227d7a6bcb258b93717969a78a31dac07
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-06T00:24:12Z

    This closes #2932

commit d2fa51b78892f7ebf13da1a5fc7bb45755440a5f
Author: Davor Bonaci <da...@google.com>
Date:   2017-05-05T23:17:43Z

    Cherry-pick pull request #2911 into release-2.0.0

commit 67ea7ae4d2144525582c7de03b17d06daa9f35bb
Author: Davor Bonaci <da...@google.com>
Date:   2017-05-05T23:20:28Z

    Cherry-pick pull request #2907 into release-2.0.0 branch

commit 96aeb97cc41b4a93bec7d72cff4887e9f358eef2
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-06T00:26:41Z

    This closes #2931

commit 1ad3f84c68235eeae6927f283180829de2f0aa33
Author: Davor Bonaci <da...@google.com>
Date:   2017-05-06T00:36:09Z

    Set Dataflow runner's worker container image for version 2.0.0

commit f97e52b3b677a5a35bac7a2012366837b7bb15cb
Author: Davor Bonaci <da...@google.com>
Date:   2017-05-06T01:46:31Z

    [maven-release-plugin] prepare release v2.0.0-RC1

commit 3b7a62301fba55f3caf68d8876b39c53e80f171a
Author: Davor Bonaci <da...@google.com>
Date:   2017-05-07T02:16:30Z

    [maven-release-plugin] rollback changes from release preparation of v2.0.0-RC1

commit a71f6cd481800a977022ce8cddce5ef9640bbe4e
Author: Kenneth Knowles <kl...@google.com>
Date:   2017-05-06T12:13:34Z

    Register the TestDataflowRunner via registrar

commit d305d6d382179c2eadd77dac3c603d73f65c80e4
Author: Kenneth Knowles <kl...@google.com>
Date:   2017-05-06T12:22:03Z

    Move TestDataflowRunner into dataflow package

commit 6eab5c9465bda3da4d8a1ea9f73a74e9c8faec85
Author: chinmaykolhatkar <ch...@apache.org>
Date:   2017-03-01T11:29:46Z

    [BEAM-831] ParDo Fusion of Apex Runner

commit 3f5282d515fa53516fda6d0376cc912560fd6d85
Author: Thomas Weise <th...@apache.org>
Date:   2017-05-05T13:45:34Z

    [BEAM-831] Fix chaining, add test.
    closes #2216

commit bec30b3beaa241483814e859d781f1e04479394b
Author: Ahmet Altay <al...@google.com>
Date:   2017-05-08T06:31:42Z

    Cherry-pick pull request #2946 in 2.0.0 release branch.
    Fix typo in datastore_wordcount.py.

commit 021468e03e5a5b0851e21f333ebc07060dc471cd
Author: Ahmet Altay <al...@google.com>
Date:   2017-05-08T17:25:40Z

    This closes #2955

commit 72241117cbf2d9682054a69ea895e4c6f6a93146
Author: Sourabh Bajaj <so...@google.com>
Date:   2017-05-07T20:55:20Z

    [BEAM-2206] Move pipelineOptions into options modules

commit c4f234c8cfb349d877eeb5c62eec7d80e844be07
Author: Sourabh Bajaj <so...@google.com>
Date:   2017-05-08T01:08:49Z

    Only cythonize files within apache_beam

commit 741bf7442d88a9e30064bd132046e5db55e7a740
Author: Ahmet Altay <al...@google.com>
Date:   2017-05-08T21:02:54Z

    This closes #2964

commit 25cda3abb0f6442f02ab6f31f0a4850be66d09d9
Author: Sourabh Bajaj <so...@google.com>
Date:   2017-05-06T02:15:48Z

    Update python dataflow worker

commit 265405bc85f9f705776e88680e3af26fab4e7de3
Author: Ahmet Altay <al...@google.com>
Date:   2017-05-08T21:06:17Z

    This closes #2943

commit e0faeeef80211ddbc632e622ecefc1e005c5ca29
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-06T02:06:03Z

    [BEAM-2212] FileBasedSource: improve message when logging.
    
    ValueProvider should not be printed, rather the string instead.

commit bff819a9858c79c6c3232b4c03f262421d325c00
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-08T16:59:16Z

    [BEAM-2212] FileBasedSource: refactor to remove uses of fileOrPatternSpec.get()
    
    Makes it less likely to have errors from printing ValueProviders instead of runtime values

commit 94d104064cc0e209fa54dd63f4cbe99cd6f2d591
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-08T21:15:48Z

    This closes #2958

commit 4ec11de1a8b876a8263c95c21b7ce830fb4e962b
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-06T00:16:34Z

    [BEAM-2190] pom.xml: do a better job of dependency management
    
    Even if Beam appears to have the correct dependencies, we cannot
    guarantee that modules that depend on us transitively get the right
    dependencies. For example, even though grpc-protobuf-lite has
    protobuf-lite excluded, and the Maven Enforcer banned-dependencies
    check passes... if a user happens to get a transitive dependency on
    grpc-all first, they may pull in grpc-protobuf from that other source
    without the exclusion. Thus we need to exclude protobuf-lite from
    grpc-all as well.
    
    While we're here, also add guava-jdk5 to the set of banned dependencies,
    though (as above) we cannot currently properly identify the places it
    might be transitively exposed in a users' pom.xml.

commit 58e2db06144abc463988284c06d553ad85dd43e2
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-08T21:26:13Z

    This closes #2957

commit 469f177a52664ab4389f8929eb52f2ed04529ec9
Author: Dan Halperin <dh...@google.com>
Date:   2017-05-06T02:49:29Z

    Convert Executor Services to use Daemon Threads
    
    This will cause the DirectRunner to automatically shut down when the
    worker threads are shut down.

commit 20bfa9411b9b77c6678c17ed465249c3dc4b210d
Author: Thomas Groh <tg...@google.com>
Date:   2017-05-08T21:36:35Z

    This closes #2961

commit 7dfc45563825b04f761af07d1cd5ae43ec38588b
Author: Kenneth Knowles <kl...@google.com>
Date:   2017-05-08T22:35:15Z

    This closes #2952: Cherry pick #2927 (Apex ParDo chaining) to release-2.0.0
    
      [BEAM-831] Fix chaining, add test. closes #2216
      [BEAM-831] ParDo Fusion of Apex Runner

commit 40bdbcb28d5507c601d0791059c3f6ac9581a8f8
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-05-08T20:41:01Z

    This closes #2953

commit 8f18344329d3af5882886a50a841d01062d408ef
Author: Eugene Kirpichov <ki...@google.com>
Date:   2017-05-08T23:06:15Z

    This closes #2970: Cherry pick #2953 to release-2.0.0

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---