You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by gi...@apache.org on 2020/11/12 02:52:00 UTC
[beam] tag nightly-master updated (2339ffc -> 02a1cd2)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/beam.git.
*** WARNING: tag nightly-master was modified! ***
from 2339ffc (commit)
to 02a1cd2 (commit)
from 2339ffc Merge pull request #13297: [BEAM-9855] Fix merge conflict between #13116 and #13240.
add 0e9db1f [BEAM-11033] Identify Dataflow metrics for portable job path based on step name. (#13298)
add 37f7eac Bump Gradle to 6.7 (#13148)
add 98c1300 Exclude more KuduIO from checker since it crashes under Java 11 which our nightly is running
add e1fdb98 Merge pull request #13300: [BEAM-11214] Exclude more KuduIO from checker since it crashes under Java 11
add c4316c5 [BEAM-11216] Fix ReaderCache to not resume from a cached reader for work item retries.
add 88d1696 Merge pull request #13293: [BEAM-11216] Fix ReaderCache to not resume from a cached reader for w…
add 28914c2 Add sdf initiated checkpoint support to portable Flink.
add cf6fd1c Merge pull request #13105 from [BEAM-10940] Add sdf initiated checkpoint support to portable Flink.
add 314efa7 [BEAM-10925] Create wrapper for user function definitions.
add ca9e4d2 Merge pull request #13307 from ibzib/udf-wrapper
add 05f5200 [BEAM-9561] Run pandas doctests in parallel. (#13286)
add 9681467 [BEAM-11074] build_release_candidate usability improvements. (#13290)
add 304dd3f [BEAM-11074] Adjust release candidate email template to encourage reviewers.
add 02a1cd2 Merge pull request #13291: [BEAM-11074] Adjust release candidate email template to encourage reviewers.
No new revisions were added by this update.
Summary of changes:
build.gradle | 2 +-
buildSrc/build.gradle | 4 +-
gradle.properties | 1 +
gradle/wrapper/gradle-wrapper.properties | 2 +-
.../src/main/scripts/build_release_candidate.sh | 39 ++-
runners/flink/job-server/flink_job_server.gradle | 10 +-
.../FlinkBatchPortablePipelineTranslator.java | 3 +-
.../FlinkStreamingPortablePipelineTranslator.java | 43 ++-
.../functions/FlinkExecutableStageFunction.java | 84 +++++-
.../wrappers/streaming/DoFnOperator.java | 31 ++-
.../streaming/ExecutableStageDoFnOperator.java | 288 ++++++++++++++++++---
...Selector.java => SdfByteBufferKeySelector.java} | 21 +-
.../FlinkExecutableStageFunctionTest.java | 14 +-
.../streaming/ExecutableStageDoFnOperatorTest.java | 18 +-
.../beam/runners/dataflow/worker/ReaderCache.java | 21 +-
.../dataflow/worker/StreamingDataflowWorker.java | 3 +
.../worker/StreamingModeExecutionContext.java | 6 +-
.../dataflow/worker/FakeWindmillServer.java | 5 +
.../runners/dataflow/worker/ReaderCacheTest.java | 75 ++++--
.../worker/StreamingDataflowWorkerTest.java | 130 ++++++++++
.../dataflow/worker/WorkerCustomSourcesTest.java | 12 +-
.../control/BundleCheckpointHandlers.java | 142 ++++++++++
.../control/DefaultJobBundleFactory.java | 6 +-
.../fnexecution/control/SdkHarnessClient.java | 17 +-
.../SingleEnvironmentInstanceJobBundleFactory.java | 6 +-
.../fnexecution/control/StageBundleFactory.java | 35 ++-
.../fnexecution/control/RemoteExecutionTest.java | 1 +
.../SparkExecutableStageFunctionTest.java | 4 +-
.../extensions/sql/zetasql/ZetaSQLPlannerImpl.java | 22 +-
.../sql/zetasql/translation/ConversionContext.java | 24 +-
.../zetasql/translation/ExpressionConverter.java | 10 +-
.../translation/UserFunctionDefinitions.java | 43 +++
sdks/java/io/kudu/build.gradle | 2 +
sdks/python/apache_beam/dataframe/doctests.py | 6 +-
.../apache_beam/dataframe/pandas_docs_test.py | 90 +++++--
.../runners/dataflow/dataflow_metrics.py | 13 +-
.../runners/dataflow/internal/apiclient.py | 8 -
.../runners/portability/flink_runner_test.py | 3 -
.../site/content/en/contribute/release-guide.md | 3 +
39 files changed, 1026 insertions(+), 221 deletions(-)
copy runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/{KvToByteBufferKeySelector.java => SdfByteBufferKeySelector.java} (64%)
create mode 100644 runners/java-fn-execution/src/main/java/org/apache/beam/runners/fnexecution/control/BundleCheckpointHandlers.java
create mode 100644 sdks/java/extensions/sql/zetasql/src/main/java/org/apache/beam/sdk/extensions/sql/zetasql/translation/UserFunctionDefinitions.java