You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by jk...@apache.org on 2018/04/25 23:08:13 UTC

[beam] branch master updated (5bb482f -> bbabb42)

This is an automated email from the ASF dual-hosted git repository.

jkff pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from 5bb482f  Merge pull request #5150:  [BEAM-4071] Add Portable Runner Job API shim
     add 7adcb3c  Moves standard URNs into .proto files
     add d1d2b92  Refactors common_urns.py
     add eba19c12 Fixes pylint errors
     add ac94f25  Fixes compile errors
     add 42fac77  Workaround for protobuf compiler bug
     add 58502e0  Fixes more references to common_urns
     new bbabb42  Merge pull request #4672: Moves standard URNs into .proto files

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .gitignore                                         |   1 -
 .../beam/model/fnexecution/v1/standard_coders.yaml |  56 ++---
 .../pipeline/src/main/proto/beam_runner_api.proto  | 141 ++++++++++++
 .../src/main/proto/standard_window_fns.proto       |  25 ++-
 .../resources/org/apache/beam/model/common_urns.md | 134 ------------
 pom.xml                                            |   1 -
 runners/core-construction-java/build.gradle        |   2 +
 runners/core-construction-java/pom.xml             |  13 ++
 .../{package-info.java => BeamUrns.java}           |  17 +-
 .../core/construction/ModelCoderRegistrar.java     |   4 +
 .../runners/core/construction/ModelCoders.java     |  19 +-
 .../core/construction/PTransformTranslation.java   |  41 ++--
 .../beam/runners/core/construction/UrnUtils.java   |  63 ------
 .../construction/WindowingStrategyTranslation.java |  82 +++----
 .../core/construction}/CommonCoderTest.java        | 241 +++++++++++----------
 .../runners/core/construction/UrnUtilsTest.java    |  59 -----
 runners/java-fn-execution/build.gradle             |   1 +
 .../control/ProcessBundleDescriptors.java          |   5 +-
 .../graph/LengthPrefixUnknownCoders.java           |  18 +-
 sdks/java/core/build.gradle                        |   1 +
 .../beam/fn/harness/WindowMappingFnRunner.java     |   6 +-
 sdks/python/apache_beam/coders/coders.py           |  18 +-
 .../apache_beam/coders/standard_coders_test.py     |  28 +--
 sdks/python/apache_beam/io/iobase.py               |   4 +-
 sdks/python/apache_beam/pipeline.py                |   2 +-
 sdks/python/apache_beam/portability/common_urns.py |  62 ++++++
 sdks/python/apache_beam/pvalue.py                  |  10 +-
 .../runners/dataflow/dataflow_runner.py            |  12 +-
 .../runners/portability/fn_api_runner.py           |  50 ++---
 .../apache_beam/runners/worker/bundle_processor.py |  24 +-
 .../apache_beam/testing/data/standard_coders.yaml  |  56 ++---
 sdks/python/apache_beam/transforms/core.py         |  25 ++-
 sdks/python/apache_beam/transforms/window.py       |  16 +-
 sdks/python/setup.py                               |  31 ---
 34 files changed, 613 insertions(+), 655 deletions(-)
 delete mode 100644 model/pipeline/src/main/resources/org/apache/beam/model/common_urns.md
 copy runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/{package-info.java => BeamUrns.java} (66%)
 delete mode 100644 runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/UrnUtils.java
 rename {sdks/java/core/src/test/java/org/apache/beam/sdk/coders => runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction}/CommonCoderTest.java (59%)
 delete mode 100644 runners/core-construction-java/src/test/java/org/apache/beam/runners/core/construction/UrnUtilsTest.java
 create mode 100644 sdks/python/apache_beam/portability/common_urns.py

-- 
To stop receiving notification emails like this one, please contact
jkff@apache.org.

[beam] 01/01: Merge pull request #4672: Moves standard URNs into .proto files

Posted by jk...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

jkff pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit bbabb4202cdbe234ab7be9a1cda57f0e8e226357
Merge: 5bb482f 58502e0
Author: Eugene Kirpichov <ek...@gmail.com>
AuthorDate: Wed Apr 25 16:08:06 2018 -0700

    Merge pull request #4672: Moves standard URNs into .proto files
    
    Moves standard URNs into .proto files

 .gitignore                                         |   1 -
 .../beam/model/fnexecution/v1/standard_coders.yaml |  56 ++---
 .../pipeline/src/main/proto/beam_runner_api.proto  | 141 ++++++++++++
 .../src/main/proto/standard_window_fns.proto       |  25 ++-
 .../resources/org/apache/beam/model/common_urns.md | 134 ------------
 pom.xml                                            |   1 -
 runners/core-construction-java/build.gradle        |   2 +
 runners/core-construction-java/pom.xml             |  13 ++
 .../beam/runners/core/construction/BeamUrns.java   |  29 +++
 .../core/construction/ModelCoderRegistrar.java     |   4 +
 .../runners/core/construction/ModelCoders.java     |  19 +-
 .../core/construction/PTransformTranslation.java   |  41 ++--
 .../beam/runners/core/construction/UrnUtils.java   |  63 ------
 .../construction/WindowingStrategyTranslation.java |  82 +++----
 .../core/construction}/CommonCoderTest.java        | 241 +++++++++++----------
 .../runners/core/construction/UrnUtilsTest.java    |  59 -----
 runners/java-fn-execution/build.gradle             |   1 +
 .../control/ProcessBundleDescriptors.java          |   5 +-
 .../graph/LengthPrefixUnknownCoders.java           |  18 +-
 sdks/java/core/build.gradle                        |   1 +
 .../beam/fn/harness/WindowMappingFnRunner.java     |   6 +-
 sdks/python/apache_beam/coders/coders.py           |  18 +-
 .../apache_beam/coders/standard_coders_test.py     |  28 +--
 sdks/python/apache_beam/io/iobase.py               |   4 +-
 sdks/python/apache_beam/pipeline.py                |   2 +-
 sdks/python/apache_beam/portability/common_urns.py |  62 ++++++
 sdks/python/apache_beam/pvalue.py                  |  10 +-
 .../runners/dataflow/dataflow_runner.py            |  12 +-
 .../runners/portability/fn_api_runner.py           |  50 ++---
 .../apache_beam/runners/worker/bundle_processor.py |  24 +-
 .../apache_beam/testing/data/standard_coders.yaml  |  56 ++---
 sdks/python/apache_beam/transforms/core.py         |  25 ++-
 sdks/python/apache_beam/transforms/window.py       |  16 +-
 sdks/python/setup.py                               |  31 ---
 34 files changed, 632 insertions(+), 648 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
jkff@apache.org.