You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/08/18 02:51:13 UTC
[beam] tag nightly-master updated (0c81997 -> 94bf7fb)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 0c81997 (commit)
to 94bf7fb (commit)
from 0c81997 Merge pull request #12575: [BEAM-10707] Adding Python docs precommit as separate suite.
add 3843e27 [BEAM-10672] Added streaming option to combine test
add 7ecc60c [BEAM-10672] Added experimental dataflow param
add 64b95e9 [BEAM-10672] Spottless Apply
add 2d04aca [BEAM-10672] Updated streaming commands
add 505edf5 [BEAM-10672] Fixes after review in combine python load test
add 504c6b7 [BEAM-10672] Changed jobType variable into mode to declare if it is streaming or batch job
add 12004fd Merge pull request #12527: [BEAM-10672] Added Python Combine load tests for streaming on Dataflow
add f058b8c [BEAM-10670] Make key coder deterministic by using upstream PCollection which uses random byte[] as the key.
add 988b804 Merge pull request #12599 from lukecwik/beam10670
add 329ed87 [BEAM-10697] Remove testPy2Cython from precommit
add dfbc3d8 Merge pull request #12604: [BEAM-10697] Remove testPy2Cython from precommit
add 81b3b07 [BEAM-9980] add groovy functions for python versions
add e1f69d7 [BEAM-9980] update dataflow test-suites to switch python versions using in tests
add dd7dda2 [BEAM-9980] version switchable dataflow tasks to be invoked
add e665cc2 [BEAM-9980] :sdks:python:test-suites:dataflow included in settings.gradle
add b9bb2a4 [BEAM-9980] Configure Python versions for Dataflow test suite tasks via settings.gradle (#12239)
add 32b67ec [BEAM-9891] Generate query execution summary table after finishing jobs (#12601)
add 49a90de [BEAM-9919] Added an External Transform API to Go SDK (#12445)
add 471b9e7 [BEAM-10679] improving XLang KafkaIO streaming test
add 8b6164d fix formatting
add a9e9935 fix incorrect coder issue
add daf774d use Create
add 94bf7fb Merge pull request #12533: [BEAM-10679] improving XLang KafkaIO streaming test
No new revisions were added by this update.
Summary of changes:
.../jenkins/job_LoadTests_Combine_Python.groovy | 58 +++++--
...mit_Python_Chicago_Taxi_Example_Dataflow.groovy | 2 +-
...ob_PostCommit_Python_MongoDBIO_Load_Test.groovy | 2 +-
build.gradle | 9 +-
.../org/apache/beam/gradle/BeamModulePlugin.groovy | 8 +
.../construction/SplittableParDoNaiveBounded.java | 2 +-
.../go/examples/xlang/wordcount/xlang_wordcount.go | 111 +++++++++++++
sdks/go/pkg/beam/core/graph/edge.go | 43 ++++-
sdks/go/pkg/beam/core/graph/xlang.go | 131 +++++++++++++++
sdks/go/pkg/beam/core/runtime/graphx/translate.go | 58 +++++--
sdks/go/pkg/beam/core/runtime/harness/harness.go | 2 +-
.../dial.go => core/runtime/xlangx/expand.go} | 29 ++--
sdks/go/pkg/beam/core/runtime/xlangx/translate.go | 178 ++++++++++++++++++++
.../beam/model/pipeline_v1/beam_runner_api.pb.go | 3 +-
sdks/go/pkg/beam/runners/universal/universal.go | 4 +
sdks/go/pkg/beam/xlang.go | 179 +++++++++++++++++++++
.../apache/beam/sdk/tpcds/BeamSqlEnvRunner.java | 67 ++++++--
.../apache/beam/sdk/tpcds/SqlTransformRunner.java | 74 +++++++--
.../apache/beam/sdk/tpcds/SummaryGenerator.java | 153 ++++++++++++++++++
.../java/org/apache/beam/sdk/tpcds/TpcdsRun.java | 26 ++-
.../org/apache/beam/sdk/tpcds/TpcdsRunResult.java | 92 +++++++++++
.../io/external/xlang_kafkaio_it_test.py | 36 +++--
.../test-suites/dataflow/{py35 => }/build.gradle | 34 ++--
sdks/python/test-suites/dataflow/common.gradle | 44 +++++
sdks/python/test-suites/dataflow/py2/build.gradle | 36 +----
sdks/python/test-suites/dataflow/py35/build.gradle | 20 +--
sdks/python/test-suites/dataflow/py36/build.gradle | 1 -
sdks/python/test-suites/dataflow/py37/build.gradle | 5 -
sdks/python/test-suites/dataflow/py38/build.gradle | 5 -
.../python/test-suites/gradle.properties | 20 +--
sdks/python/test-suites/tox/py2/build.gradle | 1 -
settings.gradle | 1 +
32 files changed, 1240 insertions(+), 194 deletions(-)
create mode 100644 sdks/go/examples/xlang/wordcount/xlang_wordcount.go
create mode 100644 sdks/go/pkg/beam/core/graph/xlang.go
copy sdks/go/pkg/beam/{util/grpcx/dial.go => core/runtime/xlangx/expand.go} (57%)
create mode 100644 sdks/go/pkg/beam/core/runtime/xlangx/translate.go
create mode 100644 sdks/go/pkg/beam/xlang.go
create mode 100644 sdks/java/testing/tpcds/src/main/java/org/apache/beam/sdk/tpcds/SummaryGenerator.java
create mode 100644 sdks/java/testing/tpcds/src/main/java/org/apache/beam/sdk/tpcds/TpcdsRunResult.java
copy sdks/python/test-suites/dataflow/{py35 => }/build.gradle (50%)
copy gradle.properties => sdks/python/test-suites/gradle.properties (70%)