You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/10/07 03:53:31 UTC

[beam] tag nightly-master updated (bed6bee -> a695fc3)

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.


*** WARNING: tag nightly-master was modified! ***

    from bed6bee  (commit)
      to a695fc3  (commit)
    from bed6bee  Merge pull request #15647 from KevinGG/beam_sql_on_df
     add 4012a46  Merge pull request #15602 from [BEAM-10917] Add support for BigQuery Read API in Python BEAM
     add 44512e9  [BEAM-12909][BEAM-12849]  Add support for running spark3 nexmark queries as part of postcommit. (#15529)
     add f7c7f26  Restore "Default to Runner v2 for Python Streaming jobs. (#15140)"
     add 7d1ec78  Avoid incompatible setting.
     add abdd396  Merge pull request #15291 Restore "Default to Runner v2 for Python Streaming jobs. (#15140)"
     add 2028e6c  Merge pull request #15510 from [BEAM-12883] Add coder for ReadableFileCoder that supports MetadataCoderV2
     add 821293e  [BEAM-12969] [Playground] Add methods to return errors as a result of requests to server
     add 840121b  Merge pull request #15615 from [BEAM-12969] [Playground] Define and implement errors of the application
     add e621b3d  Dead letter option.
     add 4c78bcd  Guard setup.py logic with __main__ condition.
     add 7dee0f0  Add the ability to use subprocesses with the dead letter queue.
     add adf8bd7  Support multi-output DoFns.
     add ce05524  multi-output fix
     add 87a4826  Add thresholding to dead letter pattern.
     add 1465a18  treshold test fixes
     add 42feaa6  Better naming, documentation.
     add 64ec15f  Merge pull request #15585 Add dead letter pattern to Beam Python DoFns.
     add addc398  Fix "too many pings" errors.
     add 5d50ab9  Increase keepalive timeout to 5 minutes.
     add 1d0a16f  Fix yapf complaints.
     add fa7065e  Merge pull request #15314 from stefanistrate/stefan-fix-too-many-pings
     add 49a96b9  [BEAM-12482] Ensure that we ignore schema update options when loading temporary tables that don't exist. (#15635)
     add 371b4fd  Moving to 2.35.0-SNAPSHOT on master branch.
     add 25387ef  Add 2.35.0 section to changelog.
     add 237d67d  Merge pull request #15670 from ibzib/changes-2.35
     add e110116  Fix email links in the contact page
     add a695fc3  Merge pull request #15671 from apache/aaltay-patch-1

No new revisions were added by this update.

Summary of changes:
 .../job_PostCommit_Java_Nexmark_Spark.groovy       |  84 +++-
 CHANGES.md                                         |  33 ++
 .../org/apache/beam/gradle/BeamModulePlugin.groovy |  17 +-
 gradle.properties                                  |   4 +-
 playground/backend/cmd/server/server.go            |   2 +-
 playground/backend/{test => internal/api}/.gitkeep |   0
 .../backend/internal/errors/grpc_errors.go         |  33 +-
 .../backend/internal/errors/grpc_errors_test.go    | 102 +++++
 .../{pkg => internal}/executors/executor.go        |   0
 .../{pkg => internal}/executors/goexecutor.go      |   0
 .../{pkg => internal}/executors/javaexecutor.go    |   0
 playground/backend/pkg/api/.gitkeep                |   0
 sdks/go/pkg/beam/core/core.go                      |   2 +-
 .../org/apache/beam/sdk/io/ReadableFileCoder.java  |  59 ++-
 .../beam/sdk/io/gcp/bigquery/BatchLoads.java       |   4 +-
 sdks/java/testing/nexmark/build.gradle             |  22 +-
 sdks/python/apache_beam/io/gcp/bigquery.py         | 489 ++++++++++++++++++++-
 .../apache_beam/io/gcp/bigquery_read_internal.py   |  46 ++
 .../apache_beam/io/gcp/bigquery_read_it_test.py    | 275 ++++++++++++
 sdks/python/apache_beam/io/gcp/bigquery_test.py    |   1 +
 sdks/python/apache_beam/io/gcp/bigquery_tools.py   |  96 +++-
 sdks/python/apache_beam/pvalue.py                  |   7 +-
 .../runners/dataflow/dataflow_runner.py            |   9 +-
 .../runners/dataflow/dataflow_runner_test.py       |  11 +-
 .../runners/portability/abstract_job_service.py    |   5 +-
 .../portability/fn_api_runner/worker_handlers.py   |  26 +-
 .../runners/portability/local_job_service.py       |  13 +-
 .../apache_beam/runners/worker/channel_factory.py  |   5 +-
 .../apache_beam/runners/worker/worker_pool_main.py |   4 +-
 sdks/python/apache_beam/transforms/core.py         | 275 +++++++++++-
 .../apache_beam/transforms/ptransform_test.py      | 231 ++++++++++
 sdks/python/apache_beam/version.py                 |   2 +-
 sdks/python/setup.py                               | 151 +++----
 .../www/site/content/en/community/contact-us.md    |   8 +-
 34 files changed, 1841 insertions(+), 175 deletions(-)
 rename playground/backend/{test => internal/api}/.gitkeep (100%)
 copy learning/katas/go/core_transforms/branching/branching/pkg/task/task.go => playground/backend/internal/errors/grpc_errors.go (52%)
 create mode 100644 playground/backend/internal/errors/grpc_errors_test.go
 rename playground/backend/{pkg => internal}/executors/executor.go (100%)
 rename playground/backend/{pkg => internal}/executors/goexecutor.go (100%)
 rename playground/backend/{pkg => internal}/executors/javaexecutor.go (100%)
 delete mode 100644 playground/backend/pkg/api/.gitkeep