You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by mx...@apache.org on 2019/06/10 11:42:53 UTC
[beam] branch release-2.7.1 updated (a882a28 -> 298e54b)
This is an automated email from the ASF dual-hosted git repository.
mxm pushed a change to branch release-2.7.1
in repository https://gitbox.apache.org/repos/asf/beam.git.
from a882a28 Merge pull request #6818: Fix errorprone to version 2.3.1 on release-2.7.0 branch
add 6d04808 Fix issues related to shutdown logic of UnboundedSourceWrapper
add 7a66768 [BEAM-6460] Remove cached class references upon start/shutdown
add a8f9ab6 [BEAM-6533] Let UnboundedSourceWrapper parallel source index start with 1
add 793a32d Upgrade to Flink 1.5.6
add 3ec4e76 [BEAM-4520] Warn when UnboundedSources are used without checkpointing
add 74db08e [BEAM-3863] Ensure correct firing of processing time timers
add 15658ea [BEAM-6929] Prevent NullPointerException in Flink's CombiningState
add bca9c6c [BEAM-3089] Fix default values in FlinkPipelineOptions / Add tests
add 7284956 Replace deprecated StateTag.StateBinder in FlinkStateInternals (#6754)
add 6df381a Merge pull request #7849: [BEAM-6678] Persist watermark holds view in Flink checkpoints
new 298e54b Merge pull request #8787: [release-2.7.1] Flink backports for LTS release
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../beam/runners/core/StateInternalsTest.java | 92 +++++-
runners/flink/build.gradle | 2 +-
.../runners/flink/DefaultParallelismFactory.java | 39 ---
.../runners/flink/FlinkExecutionEnvironments.java | 76 ++++-
.../apache/beam/runners/flink/FlinkJobInvoker.java | 5 +-
.../flink/FlinkPipelineExecutionEnvironment.java | 10 +
.../beam/runners/flink/FlinkPipelineOptions.java | 11 +-
.../org/apache/beam/runners/flink/FlinkRunner.java | 5 -
.../flink/PipelineTranslationOptimizer.java | 16 +
.../translation/functions/FlinkDoFnFunction.java | 7 +-
.../functions/FlinkStatefulDoFnFunction.java | 7 +-
.../{package-info.java => FlinkClassloading.java} | 14 +-
.../wrappers/streaming/DoFnOperator.java | 45 ++-
.../streaming/io/UnboundedSourceWrapper.java | 85 +++--
.../state/FlinkBroadcastStateInternals.java | 12 +-
.../streaming/state/FlinkStateInternals.java | 353 ++++++++++++---------
.../flink/FlinkExecutionEnvironmentsTest.java | 162 ++++++++++
.../FlinkPipelineExecutionEnvironmentTest.java | 44 +++
.../beam/runners/flink/PipelineOptionsTest.java | 26 ++
.../flink/streaming/BoundedSourceRestoreTest.java | 1 +
.../runners/flink/streaming/DoFnOperatorTest.java | 49 ++-
.../streaming/FlinkKeyGroupStateInternalsTest.java | 8 +
.../streaming/FlinkSplitStateInternalsTest.java | 8 +
.../flink/streaming/FlinkStateInternalsTest.java | 108 ++++++-
.../flink/streaming/GroupByNullKeyTest.java | 2 +
.../wrappers/streaming/io}/TestCountingSource.java | 15 +-
.../streaming/io}/UnboundedSourceWrapperTest.java | 207 +++++++++---
runners/flink/src/test/resources/flink-conf.yaml | 19 ++
.../spark/stateful/SparkStateInternals.java | 3 +-
29 files changed, 1102 insertions(+), 329 deletions(-)
delete mode 100644 runners/flink/src/main/java/org/apache/beam/runners/flink/DefaultParallelismFactory.java
copy runners/flink/src/main/java/org/apache/beam/runners/flink/translation/utils/{package-info.java => FlinkClassloading.java} (70%)
create mode 100644 runners/flink/src/test/java/org/apache/beam/runners/flink/FlinkExecutionEnvironmentsTest.java
rename runners/flink/src/test/java/org/apache/beam/runners/flink/{streaming => translation/wrappers/streaming/io}/TestCountingSource.java (95%)
rename runners/flink/src/test/java/org/apache/beam/runners/flink/{streaming => translation/wrappers/streaming/io}/UnboundedSourceWrapperTest.java (73%)
create mode 100644 runners/flink/src/test/resources/flink-conf.yaml
[beam] 01/01: Merge pull request #8787: [release-2.7.1] Flink
backports for LTS release
Posted by mx...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mxm pushed a commit to branch release-2.7.1
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 298e54bfeedb45a0ced6fd4a32d80bdbb94e1774
Merge: a882a28 6df381a
Author: Maximilian Michels <mx...@apache.org>
AuthorDate: Mon Jun 10 13:42:28 2019 +0200
Merge pull request #8787: [release-2.7.1] Flink backports for LTS release
.../beam/runners/core/StateInternalsTest.java | 92 +++++-
runners/flink/build.gradle | 2 +-
.../runners/flink/DefaultParallelismFactory.java | 39 ---
.../runners/flink/FlinkExecutionEnvironments.java | 76 ++++-
.../apache/beam/runners/flink/FlinkJobInvoker.java | 5 +-
.../flink/FlinkPipelineExecutionEnvironment.java | 10 +
.../beam/runners/flink/FlinkPipelineOptions.java | 11 +-
.../org/apache/beam/runners/flink/FlinkRunner.java | 5 -
.../flink/PipelineTranslationOptimizer.java | 16 +
.../translation/functions/FlinkDoFnFunction.java | 7 +-
.../functions/FlinkStatefulDoFnFunction.java | 7 +-
.../flink/translation/utils/FlinkClassloading.java | 30 ++
.../wrappers/streaming/DoFnOperator.java | 45 ++-
.../streaming/io/UnboundedSourceWrapper.java | 85 +++--
.../state/FlinkBroadcastStateInternals.java | 12 +-
.../streaming/state/FlinkStateInternals.java | 353 ++++++++++++---------
.../flink/FlinkExecutionEnvironmentsTest.java | 162 ++++++++++
.../FlinkPipelineExecutionEnvironmentTest.java | 44 +++
.../beam/runners/flink/PipelineOptionsTest.java | 26 ++
.../flink/streaming/BoundedSourceRestoreTest.java | 1 +
.../runners/flink/streaming/DoFnOperatorTest.java | 49 ++-
.../streaming/FlinkKeyGroupStateInternalsTest.java | 8 +
.../streaming/FlinkSplitStateInternalsTest.java | 8 +
.../flink/streaming/FlinkStateInternalsTest.java | 108 ++++++-
.../flink/streaming/GroupByNullKeyTest.java | 2 +
.../wrappers/streaming/io}/TestCountingSource.java | 15 +-
.../streaming/io}/UnboundedSourceWrapperTest.java | 207 +++++++++---
runners/flink/src/test/resources/flink-conf.yaml | 19 ++
.../spark/stateful/SparkStateInternals.java | 3 +-
29 files changed, 1120 insertions(+), 327 deletions(-)