You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by ga...@apache.org on 2022/03/08 13:53:03 UTC
[flink] branch master updated (13b203f -> 955e5ff)
This is an automated email from the ASF dual-hosted git repository.
gaoyunhaii pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 13b203f [FLINK-26440][connector/filesystem] Make CompactorOperatorStateHandler supporting unaligned checkpoint.
add 948f571 [hotfix][streaming] Enabling GlobalCommitter SinkITCases
add 955e5ff [FLINK-26516][streaming] Recover GlobalCommittables with Sink V1 GlobalCommittable serializer
No new revisions were added by this update.
Summary of changes:
.../connector/sink2/GlobalCommittableWrapper.java | 31 +-
.../connector/sink2/GlobalCommitterOperator.java | 63 +++-
.../connector/sink2/GlobalCommitterSerializer.java | 140 ++++++++
.../api/transformations/SinkV1Adapter.java | 24 +-
.../sink/SinkV1WriterCommittableSerializer.java | 57 +++
.../runtime/operators/sink/SinkWriterOperator.java | 71 +++-
.../sink/committables/CommittableCollector.java | 2 +-
.../CommittableCollectorSerializer.java | 17 +-
.../SinkV1CommittableDeserializer.java | 55 +++
.../translators/SinkTransformationTranslator.java | 15 +-
.../sink2/GlobalCommitterSerializerTest.java | 123 +++++++
.../operators/sink/SinkWriterOperatorTest.java | 129 +++++++
.../CommittableCollectorSerializerTest.java | 35 +-
.../flink/test/streaming/runtime/SinkITCase.java | 5 -
.../runtime/UnifiedSinkMigrationITCase.java | 382 +++++++++++++++++++++
.../savepoint-7bd90b-3a2cda6957cb/_metadata | Bin 0 -> 1640 bytes
16 files changed, 1064 insertions(+), 85 deletions(-)
copy flink-core/src/main/java/org/apache/flink/api/common/io/compression/XZInputStreamFactory.java => flink-streaming-java/src/main/java/org/apache/flink/streaming/api/connector/sink2/GlobalCommittableWrapper.java (53%)
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/api/connector/sink2/GlobalCommitterSerializer.java
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/sink/SinkV1WriterCommittableSerializer.java
create mode 100644 flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/sink/committables/SinkV1CommittableDeserializer.java
create mode 100644 flink-streaming-java/src/test/java/org/apache/flink/streaming/api/connector/sink2/GlobalCommitterSerializerTest.java
create mode 100644 flink-tests/src/test/java/org/apache/flink/test/streaming/runtime/UnifiedSinkMigrationITCase.java
create mode 100644 flink-tests/src/test/resources/unified-sink-migration-test/savepoint-7bd90b-3a2cda6957cb/_metadata