You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2021/08/13 03:23:51 UTC
[beam] tag nightly-master updated (55f42a5 -> c5b6a9a)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 55f42a5 (commit)
to c5b6a9a (commit)
from 55f42a5 [GoSDK Infra] Limit simultaneous tests binaries to 3. (#15321)
add a440401 [BEAM-6374] Emit PCollection metrics from GoSDK (#15289)
add 7f6a1c6 [BEAM-11779] Remove appliance restriction.
add 066b0fb [BEAM-11779] Remove appliance restriction.
add 7c284e3 Python Kata - Event Time Triggers
add e866d77 Python Kata - Event Time Triggers - Added license to task-info.yaml
add 2522867 Python Kata - Event Time Triggers - refactored the accumulation mode setting
add f96bec3 Python Kata - Event Time Triggers - task description corrected to reflect the sample data generated
add ceade99 Python Kata - Event Time Triggers - added streaming options
add ffe375a Python Kata - Event Time Triggers - add license text in task-info.yaml
add 77bace2 Python Kata - Early Triggers
add 526d6b9 Python Kata - Event Time Triggers & Early Triggers - task.md - corrected documentation link
add 1ce39b7 Python Kata - Window Accumulation Mode
add 5d7781c Python Kata - Event Time Triggers - removed the external transform commented code
add 9f24c4f Merge branch 'apache:master' into python-katas-update
add cfc847d Python Kata - added license to course-info.yaml
add a14f7e8 Merge pull request #15258 from Python katas update (Timers, Triggers, etc).
add faac725 Merge pull request #15165 from [BEAM-12593] Verify DataFrame API on pandas 1.3.0
add 413ade2 Add retry_gcs_file_copy when 500 errros happen from server
add 9332f9b [BEAM-12567] Retry GCS failure #15303
add 6fb4afe Merge pull request #15265 from [BEAM-12545] Extend FileSink by create_metadata
add 31f81bc Loosen typing extensions requirement
add dcf5e8e Merge pull request #15233: Loosen typing extensions requirement
add 2b96f43 [BEAM-12453]: Add interface to access I/O topic information for a Samza Beam job and PipelineJsonRenderer to create the JSON Beam DAG (#14945)
add bd9e4d3 [BEAM-10212] Guard state caching with experiment (#15319)
add 9378cd9 [BEAM-12719] ZetaSQL docs: replace out of date table with link to source.
add c5b6a9a Merge pull request #15282 from ibzib/BEAM-12719
No new revisions were added by this update.
Summary of changes:
.../Early Triggers/generate_event.py | 58 ++++++
.../Early Triggers/Early Triggers/task-info.yaml} | 25 ++-
.../Triggers/Early Triggers/Early Triggers/task.md | 59 ++++++
.../Triggers/Early Triggers/Early Triggers/task.py | 51 +++++
.../Early Triggers/Early Triggers/tests.py | 82 ++++++++
.../Triggers/Early Triggers/lesson-info.yaml | 0
.../Event Time Triggers/generate_event.py | 57 ++++++
.../Event Time Triggers/task-info.yaml} | 25 ++-
.../Event Time Triggers/task.md | 70 +++++++
.../Event Time Triggers/task.py | 50 +++++
.../Event Time Triggers/tests.py | 87 +++++++++
.../Event Time Triggers/lesson-info.yaml} | 13 +-
.../Window Accumulation Mode/generate_event.py | 58 ++++++
.../Window Accumulation Mode/task-info.yaml} | 25 ++-
.../Window Accumulation Mode/task.md | 64 +++++++
.../Window Accumulation Mode/task.py | 51 +++++
.../Window Accumulation Mode/tests.py | 82 ++++++++
.../Window Accumulation Mode/lesson-info.yaml | 0
.../{kotlin => python}/Triggers/section-info.yaml | 0
learning/katas/python/course-info.yaml | 3 +-
.../fnexecution/control/RemoteExecutionTest.java | 25 ++-
runners/samza/build.gradle | 1 +
.../org/apache/beam/runners/samza/SamzaRunner.java | 19 +-
.../runners/samza/util/PipelineJsonRenderer.java | 209 +++++++++++++++++++++
.../samza/util/PipelineJsonRendererTest.java | 105 +++++++++++
runners/samza/src/test/resources/ExpectedDag.json | 68 +++++++
sdks/go/pkg/beam/core/metrics/store.go | 22 +++
sdks/go/pkg/beam/core/runtime/exec/datasink.go | 15 +-
sdks/go/pkg/beam/core/runtime/exec/datasource.go | 79 +++++---
.../pkg/beam/core/runtime/exec/datasource_test.go | 39 ++--
sdks/go/pkg/beam/core/runtime/exec/pcollection.go | 158 ++++++++++++++++
.../pkg/beam/core/runtime/exec/pcollection_test.go | 154 +++++++++++++++
sdks/go/pkg/beam/core/runtime/exec/plan.go | 75 ++++----
sdks/go/pkg/beam/core/runtime/exec/translate.go | 38 +++-
sdks/go/pkg/beam/core/runtime/harness/harness.go | 29 ++-
.../go/pkg/beam/core/runtime/harness/monitoring.go | 78 +++++---
sdks/go/pkg/beam/runners/dataflow/dataflow.go | 2 -
sdks/go/pkg/beam/runners/direct/direct.go | 3 +-
.../fn/harness/control/ProcessBundleHandler.java | 22 ++-
sdks/python/apache_beam/dataframe/frames.py | 21 ++-
sdks/python/apache_beam/dataframe/frames_test.py | 46 ++++-
.../apache_beam/dataframe/pandas_doctests_test.py | 58 +++++-
sdks/python/apache_beam/io/fileio.py | 44 ++++-
.../runners/dataflow/internal/apiclient.py | 3 +-
sdks/python/setup.py | 4 +-
.../en/documentation/dsls/sql/zetasql/overview.md | 31 +--
46 files changed, 1941 insertions(+), 267 deletions(-)
create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/generate_event.py
copy learning/katas/python/{course-info.yaml => Triggers/Early Triggers/Early Triggers/task-info.yaml} (69%)
create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/task.md
create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/task.py
create mode 100644 learning/katas/python/Triggers/Early Triggers/Early Triggers/tests.py
copy learning/katas/{kotlin => python}/Triggers/Early Triggers/lesson-info.yaml (100%)
create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/generate_event.py
copy learning/katas/python/{course-info.yaml => Triggers/Event Time Triggers/Event Time Triggers/task-info.yaml} (69%)
create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/task.md
create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/task.py
create mode 100644 learning/katas/python/Triggers/Event Time Triggers/Event Time Triggers/tests.py
copy learning/katas/python/{course-info.yaml => Triggers/Event Time Triggers/lesson-info.yaml} (70%)
create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation Mode/generate_event.py
copy learning/katas/python/{course-info.yaml => Triggers/Window Accumulation Mode/Window Accumulation Mode/task-info.yaml} (69%)
create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation Mode/task.md
create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation Mode/task.py
create mode 100644 learning/katas/python/Triggers/Window Accumulation Mode/Window Accumulation Mode/tests.py
copy learning/katas/{kotlin => python}/Triggers/Window Accumulation Mode/lesson-info.yaml (100%)
copy learning/katas/{kotlin => python}/Triggers/section-info.yaml (100%)
create mode 100644 runners/samza/src/main/java/org/apache/beam/runners/samza/util/PipelineJsonRenderer.java
create mode 100644 runners/samza/src/test/java/org/apache/beam/runners/samza/util/PipelineJsonRendererTest.java
create mode 100644 runners/samza/src/test/resources/ExpectedDag.json
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/pcollection.go
create mode 100644 sdks/go/pkg/beam/core/runtime/exec/pcollection_test.go