You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/08/18 02:51:13 UTC

[beam] tag nightly-master updated (0c81997 -> 94bf7fb)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.


*** WARNING: tag nightly-master was modified! ***

    from 0c81997  (commit)
      to 94bf7fb  (commit)
    from 0c81997  Merge pull request #12575: [BEAM-10707] Adding Python docs precommit as separate suite.
     add 3843e27  [BEAM-10672] Added streaming option to combine test
     add 7ecc60c  [BEAM-10672] Added experimental dataflow param
     add 64b95e9  [BEAM-10672] Spottless Apply
     add 2d04aca  [BEAM-10672] Updated streaming commands
     add 505edf5  [BEAM-10672] Fixes after review in combine python load test
     add 504c6b7  [BEAM-10672] Changed jobType variable into mode to declare if it is streaming or batch job
     add 12004fd  Merge pull request #12527: [BEAM-10672] Added Python Combine load tests for streaming on Dataflow
     add f058b8c  [BEAM-10670] Make key coder deterministic by using upstream PCollection which uses random byte[] as the key.
     add 988b804  Merge pull request #12599 from lukecwik/beam10670
     add 329ed87  [BEAM-10697] Remove testPy2Cython from precommit
     add dfbc3d8  Merge pull request #12604: [BEAM-10697] Remove testPy2Cython from precommit
     add 81b3b07  [BEAM-9980] add groovy functions for python versions
     add e1f69d7  [BEAM-9980] update dataflow test-suites to switch python versions using in tests
     add dd7dda2  [BEAM-9980] version switchable dataflow tasks to be invoked
     add e665cc2  [BEAM-9980] :sdks:python:test-suites:dataflow included in settings.gradle
     add b9bb2a4  [BEAM-9980] Configure Python versions for Dataflow test suite tasks via settings.gradle (#12239)
     add 32b67ec  [BEAM-9891] Generate query execution summary table after finishing jobs (#12601)
     add 49a90de  [BEAM-9919] Added an External Transform API to Go SDK (#12445)
     add 471b9e7  [BEAM-10679] improving XLang KafkaIO streaming test
     add 8b6164d  fix formatting
     add a9e9935  fix incorrect coder issue
     add daf774d  use Create
     add 94bf7fb  Merge pull request #12533: [BEAM-10679] improving XLang KafkaIO streaming test

No new revisions were added by this update.

Summary of changes:
 .../jenkins/job_LoadTests_Combine_Python.groovy    |  58 +++++--
 ...mit_Python_Chicago_Taxi_Example_Dataflow.groovy |   2 +-
 ...ob_PostCommit_Python_MongoDBIO_Load_Test.groovy |   2 +-
 build.gradle                                       |   9 +-
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |   8 +
 .../construction/SplittableParDoNaiveBounded.java  |   2 +-
 .../go/examples/xlang/wordcount/xlang_wordcount.go | 111 +++++++++++++
 sdks/go/pkg/beam/core/graph/edge.go                |  43 ++++-
 sdks/go/pkg/beam/core/graph/xlang.go               | 131 +++++++++++++++
 sdks/go/pkg/beam/core/runtime/graphx/translate.go  |  58 +++++--
 sdks/go/pkg/beam/core/runtime/harness/harness.go   |   2 +-
 .../dial.go => core/runtime/xlangx/expand.go}      |  29 ++--
 sdks/go/pkg/beam/core/runtime/xlangx/translate.go  | 178 ++++++++++++++++++++
 .../beam/model/pipeline_v1/beam_runner_api.pb.go   |   3 +-
 sdks/go/pkg/beam/runners/universal/universal.go    |   4 +
 sdks/go/pkg/beam/xlang.go                          | 179 +++++++++++++++++++++
 .../apache/beam/sdk/tpcds/BeamSqlEnvRunner.java    |  67 ++++++--
 .../apache/beam/sdk/tpcds/SqlTransformRunner.java  |  74 +++++++--
 .../apache/beam/sdk/tpcds/SummaryGenerator.java    | 153 ++++++++++++++++++
 .../java/org/apache/beam/sdk/tpcds/TpcdsRun.java   |  26 ++-
 .../org/apache/beam/sdk/tpcds/TpcdsRunResult.java  |  92 +++++++++++
 .../io/external/xlang_kafkaio_it_test.py           |  36 +++--
 .../test-suites/dataflow/{py35 => }/build.gradle   |  34 ++--
 sdks/python/test-suites/dataflow/common.gradle     |  44 +++++
 sdks/python/test-suites/dataflow/py2/build.gradle  |  36 +----
 sdks/python/test-suites/dataflow/py35/build.gradle |  20 +--
 sdks/python/test-suites/dataflow/py36/build.gradle |   1 -
 sdks/python/test-suites/dataflow/py37/build.gradle |   5 -
 sdks/python/test-suites/dataflow/py38/build.gradle |   5 -
 .../python/test-suites/gradle.properties           |  20 +--
 sdks/python/test-suites/tox/py2/build.gradle       |   1 -
 settings.gradle                                    |   1 +
 32 files changed, 1240 insertions(+), 194 deletions(-)
 create mode 100644 sdks/go/examples/xlang/wordcount/xlang_wordcount.go
 create mode 100644 sdks/go/pkg/beam/core/graph/xlang.go
 copy sdks/go/pkg/beam/{util/grpcx/dial.go => core/runtime/xlangx/expand.go} (57%)
 create mode 100644 sdks/go/pkg/beam/core/runtime/xlangx/translate.go
 create mode 100644 sdks/go/pkg/beam/xlang.go
 create mode 100644 sdks/java/testing/tpcds/src/main/java/org/apache/beam/sdk/tpcds/SummaryGenerator.java
 create mode 100644 sdks/java/testing/tpcds/src/main/java/org/apache/beam/sdk/tpcds/TpcdsRunResult.java
 copy sdks/python/test-suites/dataflow/{py35 => }/build.gradle (50%)
 copy gradle.properties => sdks/python/test-suites/gradle.properties (70%)