You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ie...@apache.org on 2018/01/30 13:50:10 UTC

[beam] branch master updated (dc24beb -> 5391053)

This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


    from dc24beb  Merge pull request #3839: Add javadoc to ConsoleIO
     add 994c7f3  [BEAM-2469] Handling Kinesis shards splits and merges
     new 5391053  Merge pull request #4243: [BEAM-2469] Handling Kinesis shards splits and merges

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../sdk/io/kinesis/DynamicCheckpointGenerator.java |  27 ++-
 .../apache/beam/sdk/io/kinesis/KinesisReader.java  |  12 +-
 ...-info.java => KinesisShardClosedException.java} |  10 +-
 .../beam/sdk/io/kinesis/ShardReadersPool.java      | 167 +++++++++++--
 .../beam/sdk/io/kinesis/ShardRecordsIterator.java  |  27 ++-
 .../sdk/io/kinesis/StartingPointShardsFinder.java  | 193 +++++++++++++++
 .../io/kinesis/DynamicCheckpointGeneratorTest.java |  35 ++-
 .../beam/sdk/io/kinesis/KinesisReaderTest.java     |  20 +-
 .../beam/sdk/io/kinesis/ShardReadersPoolTest.java  | 126 ++++++++--
 .../sdk/io/kinesis/ShardRecordsIteratorTest.java   |   6 +-
 .../io/kinesis/StartingPointShardsFinderTest.java  | 264 +++++++++++++++++++++
 11 files changed, 836 insertions(+), 51 deletions(-)
 copy sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/{package-info.java => KinesisShardClosedException.java} (80%)
 create mode 100644 sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/StartingPointShardsFinder.java
 create mode 100644 sdks/java/io/kinesis/src/test/java/org/apache/beam/sdk/io/kinesis/StartingPointShardsFinderTest.java

-- 
To stop receiving notification emails like this one, please contact
iemejia@apache.org.

[beam] 01/01: Merge pull request #4243: [BEAM-2469] Handling Kinesis shards splits and merges

Posted by ie...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

iemejia pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 5391053039f2e9951f05d50898530f3b81d54252
Merge: dc24beb 994c7f3
Author: Ismaël Mejía <ie...@gmail.com>
AuthorDate: Tue Jan 30 14:50:02 2018 +0100

    Merge pull request #4243: [BEAM-2469] Handling Kinesis shards splits and merges

 .../sdk/io/kinesis/DynamicCheckpointGenerator.java |  27 ++-
 .../apache/beam/sdk/io/kinesis/KinesisReader.java  |  12 +-
 .../io/kinesis/KinesisShardClosedException.java    |  28 +++
 .../beam/sdk/io/kinesis/ShardReadersPool.java      | 167 +++++++++++--
 .../beam/sdk/io/kinesis/ShardRecordsIterator.java  |  27 ++-
 .../sdk/io/kinesis/StartingPointShardsFinder.java  | 193 +++++++++++++++
 .../io/kinesis/DynamicCheckpointGeneratorTest.java |  35 ++-
 .../beam/sdk/io/kinesis/KinesisReaderTest.java     |  20 +-
 .../beam/sdk/io/kinesis/ShardReadersPoolTest.java  | 126 ++++++++--
 .../sdk/io/kinesis/ShardRecordsIteratorTest.java   |   6 +-
 .../io/kinesis/StartingPointShardsFinderTest.java  | 264 +++++++++++++++++++++
 11 files changed, 856 insertions(+), 49 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
iemejia@apache.org.