You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by ar...@apache.org on 2020/03/03 17:16:52 UTC

[beam] branch master updated (b853016 -> 873f689)

This is an automated email from the ASF dual-hosted git repository.

aromanenko pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from b853016  Merge pull request #11013: Add metrics export to documentation on the website.
     add 873f689  [BEAM-8382] Add rate limit policy to KinesisIO.Read (#9765)

No new revisions were added by this update.

Summary of changes:
 ...n.java => KinesisClientThrottledException.java} |   6 +-
 .../org/apache/beam/sdk/io/kinesis/KinesisIO.java  | 113 ++++++++++++++++++++-
 .../apache/beam/sdk/io/kinesis/KinesisReader.java  |   6 ++
 .../apache/beam/sdk/io/kinesis/KinesisSource.java  |   9 ++
 .../{WatermarkPolicy.java => RateLimitPolicy.java} |  20 ++--
 .../sdk/io/kinesis/RateLimitPolicyFactory.java     |  68 +++++++++++++
 .../beam/sdk/io/kinesis/ShardReadersPool.java      |  18 +++-
 .../sdk/io/kinesis/SimplifiedKinesisClient.java    |   2 +-
 .../beam/sdk/io/kinesis/KinesisReaderTest.java     |   1 +
 .../sdk/io/kinesis/RateLimitPolicyFactoryTest.java |  88 ++++++++++++++++
 .../beam/sdk/io/kinesis/ShardReadersPoolTest.java  |  54 +++++++++-
 .../io/kinesis/SimplifiedKinesisClientTest.java    |  13 +--
 12 files changed, 371 insertions(+), 27 deletions(-)
 copy sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/{TransientKinesisException.java => KinesisClientThrottledException.java} (80%)
 copy sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/{WatermarkPolicy.java => RateLimitPolicy.java} (62%)
 create mode 100644 sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/RateLimitPolicyFactory.java
 create mode 100644 sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/RateLimitPolicyFactoryTest.java