You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ar...@apache.org on 2019/05/16 15:42:31 UTC

[beam] 01/01: Merge pull request #8513: [BEAM-7240] Kinesis IO Watermark Computation Improvements

This is an automated email from the ASF dual-hosted git repository.

aromanenko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 288c95fdd1ac49e1c6cc336145b5f3a9cc4bf395
Merge: 2fbb1ee 9fe0a03
Author: Alexey Romanenko <33...@users.noreply.github.com>
AuthorDate: Thu May 16 17:42:13 2019 +0200

    Merge pull request #8513: [BEAM-7240] Kinesis IO Watermark Computation Improvements

 sdks/java/io/kinesis/build.gradle                  |   1 +
 .../org/apache/beam/sdk/io/kinesis/KinesisIO.java  |  89 ++++++++++++
 .../apache/beam/sdk/io/kinesis/KinesisReader.java  |  21 ++-
 .../apache/beam/sdk/io/kinesis/KinesisSource.java  |   7 +
 .../beam/sdk/io/kinesis/KinesisWatermark.java      | 116 ----------------
 .../beam/sdk/io/kinesis/ShardReadersPool.java      |  27 ++--
 .../beam/sdk/io/kinesis/ShardRecordsIterator.java  |  24 +++-
 .../beam/sdk/io/kinesis/WatermarkParameters.java   |  98 +++++++++++++
 .../beam/sdk/io/kinesis/WatermarkPolicy.java       |  29 ++++
 .../sdk/io/kinesis/WatermarkPolicyFactory.java     | 152 +++++++++++++++++++++
 .../beam/sdk/io/kinesis/KinesisMockReadTest.java   |   1 +
 .../beam/sdk/io/kinesis/KinesisReaderTest.java     |  41 ++----
 .../beam/sdk/io/kinesis/KinesisWatermarkTest.java  | 138 -------------------
 .../beam/sdk/io/kinesis/ShardReadersPoolTest.java  |  61 +++++----
 .../sdk/io/kinesis/ShardRecordsIteratorTest.java   |  16 ++-
 .../beam/sdk/io/kinesis/WatermarkPolicyTest.java   | 152 +++++++++++++++++++++
 16 files changed, 639 insertions(+), 334 deletions(-)