[beam] branch nightly-refs/heads/master updated (408664b3c3d -> b8e2e85ab1f)

[gi...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git


    from 408664b3c3d [BEAM-11104] Add code snippet for Go SDK Self-Checkpointing (#17956)
     add d83da392b46 [BEAM-13769]Add no_xdist marker for cloudpickle test (#17538)
     add f7eb5ae02f8 [BEAM-14533] Bump cloudpickle to 2.1.0 (#17780)
     add c97545092cf Add basic byte size estimation for batches (#17771)
     add 0de98210f45 Add @yields_batches and @yields_elements (#19268)
     add 913c81e3f35 [BEAM-14535] Added support for pandas in sklearn inference runner (#17800)
     add 997623d9212 Merge ModelLoader and InferenceRunner into same class. (#21795)
     add 0653395d778 Merge pull request #17589 from [BEAM-14422] Exception testing for ReadFromBigQuery
     add a079e97bed6 Add README for image classification example (#21758)
     add 8c3d322e736 fixup: bug
     add ef7cd0c4889 Merge pull request #21805 from AnandInguva/sklearn-tests-bug
     add 689c1894f4b Fix every PR linking to PR 123 (#21802)
     add 3c5ea0dfd50 Add native PubSub IO prototype to Go (#17955)
     add db4141bc16f Allow creation of dynamically defined transforms in the Python expansion service. (#17822)
     add b8e2e85ab1f Make keying of examples explicit. (#21777)

No new revisions were added by this update.

Summary of changes:
 .github/PULL_REQUEST_TEMPLATE.md                   |   2 +-
 .../native_wordcap/nativepubsubio/native.go        | 247 ++++++++++++++++++
 .../nativepubsubio/subscriptiontracker.go          |  78 ++++++
 .../wordcap.go                                     |  12 +-
 .../apache/beam/sdk/util/PythonCallableSource.java |   2 +-
 .../extensions/python/PythonExternalTransform.java |  37 +++
 .../apache_beam/examples/inference/README.md       | 114 +++++++++
 sdks/python/apache_beam/io/gcp/bigquery_test.py    | 189 ++++++++++++++
 sdks/python/apache_beam/ml/inference/api.py        |   2 +-
 sdks/python/apache_beam/ml/inference/base.py       | 181 ++++++++++----
 sdks/python/apache_beam/ml/inference/base_test.py  |  68 ++---
 .../apache_beam/ml/inference/pytorch_inference.py  | 107 ++++----
 .../ml/inference/pytorch_inference_test.py         |  42 ++--
 .../apache_beam/ml/inference/sklearn_inference.py  |  88 ++++---
 .../ml/inference/sklearn_inference_test.py         | 138 ++++++++++-
 sdks/python/apache_beam/runners/common.pxd         |  37 ++-
 sdks/python/apache_beam/runners/common.py          | 276 ++++++++++++---------
 .../runners/direct/sdf_direct_runner.py            |  12 +-
 .../portability/fn_api_runner/fn_runner_test.py    |  45 ++++
 .../apache_beam/runners/portability/stager_test.py |   4 +-
 .../apache_beam/runners/worker/opcounters.py       |  10 +-
 .../apache_beam/runners/worker/opcounters_test.py  |  25 ++
 .../apache_beam/transforms/batch_dofn_test.py      |  77 ++++--
 sdks/python/apache_beam/transforms/core.py         | 106 ++++++--
 sdks/python/apache_beam/transforms/cy_combiners.py |  32 +++
 .../cy_dataflow_distribution_counter.pxd           |   2 +
 .../cy_dataflow_distribution_counter.pyx           |  14 ++
 .../transforms/fully_qualified_named_transform.py  |  27 +-
 .../fully_qualified_named_transform_test.py        |  39 +++
 .../transforms/py_dataflow_distribution_counter.py |  20 ++
 sdks/python/apache_beam/transforms/window.py       |  11 +
 sdks/python/apache_beam/typehints/batch.py         |  28 +++
 sdks/python/apache_beam/typehints/batch_test.py    |  47 +++-
 sdks/python/apache_beam/utils/counters.pxd         |   1 +
 sdks/python/apache_beam/utils/counters.py          |   9 +
 sdks/python/apache_beam/utils/counters_test.py     |  87 +++++++
 sdks/python/apache_beam/utils/python_callable.py   |  14 +-
 .../apache_beam/utils/python_callable_test.py      |  19 ++
 sdks/python/apache_beam/utils/windowed_value.py    |  11 +
 .../container/py37/base_image_requirements.txt     |   2 +-
 .../container/py38/base_image_requirements.txt     |   2 +-
 .../container/py39/base_image_requirements.txt     |   2 +-
 sdks/python/setup.py                               |   2 +-
 43 files changed, 1866 insertions(+), 402 deletions(-)
 create mode 100644 sdks/go/examples/native_wordcap/nativepubsubio/native.go
 create mode 100644 sdks/go/examples/native_wordcap/nativepubsubio/subscriptiontracker.go
 copy sdks/go/examples/{streaming_wordcap => native_wordcap}/wordcap.go (83%)
 create mode 100644 sdks/python/apache_beam/examples/inference/README.md