You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by st...@apache.org on 2022/12/06 21:25:13 UTC

[iceberg] branch master updated (75bf001eef -> b176202d8e)

This is an automated email from the ASF dual-hosted git repository.

stevenwu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git


    from 75bf001eef Python: Fix PyArrow import (#6362)
     add b176202d8e Flink: backport split discovery throttling for FLIP-27 source to 1.14 and 1.15 (#6363)

No new revisions were added by this update.

Summary of changes:
 .../apache/iceberg/flink/source/IcebergSource.java |   3 +-
 .../flink/source/assigner/SimpleSplitAssigner.java |  11 +-
 .../flink/source/assigner/SplitAssigner.java       |  22 +++-
 .../enumerator/ContinuousIcebergEnumerator.java    |  65 ++++++++---
 .../enumerator/ContinuousSplitPlannerImpl.java     |  26 ++++-
 .../source/enumerator/EnumerationHistory.java      |   0
 .../source/enumerator/IcebergEnumeratorState.java  |  15 +++
 .../IcebergEnumeratorStateSerializer.java          | 119 +++++++++++++++++----
 .../source/enumerator/StaticIcebergEnumerator.java |  15 +--
 .../enumerator/ManualContinuousSplitPlanner.java   |  67 +++++++++---
 .../TestContinuousIcebergEnumerator.java           |  96 +++++++++++++++--
 .../enumerator/TestContinuousSplitPlannerImpl.java |  74 +++++++++++++
 .../source/enumerator/TestEnumerationHistory.java  |   0
 .../TestIcebergEnumeratorStateSerializer.java      |  64 +++++++++--
 .../apache/iceberg/flink/source/IcebergSource.java |   3 +-
 .../flink/source/assigner/SimpleSplitAssigner.java |  11 +-
 .../flink/source/assigner/SplitAssigner.java       |  22 +++-
 .../enumerator/ContinuousIcebergEnumerator.java    |  65 ++++++++---
 .../enumerator/ContinuousSplitPlannerImpl.java     |  26 ++++-
 .../source/enumerator/EnumerationHistory.java      |   0
 .../source/enumerator/IcebergEnumeratorState.java  |  15 +++
 .../IcebergEnumeratorStateSerializer.java          | 119 +++++++++++++++++----
 .../source/enumerator/StaticIcebergEnumerator.java |  15 +--
 .../enumerator/ManualContinuousSplitPlanner.java   |  67 +++++++++---
 .../TestContinuousIcebergEnumerator.java           |  96 +++++++++++++++--
 .../enumerator/TestContinuousSplitPlannerImpl.java |  74 +++++++++++++
 .../source/enumerator/TestEnumerationHistory.java  |   0
 .../TestIcebergEnumeratorStateSerializer.java      |  64 +++++++++--
 28 files changed, 976 insertions(+), 178 deletions(-)
 copy flink/{v1.16 => v1.14}/flink/src/main/java/org/apache/iceberg/flink/source/enumerator/EnumerationHistory.java (100%)
 copy flink/{v1.16 => v1.14}/flink/src/test/java/org/apache/iceberg/flink/source/enumerator/TestEnumerationHistory.java (100%)
 copy flink/{v1.16 => v1.15}/flink/src/main/java/org/apache/iceberg/flink/source/enumerator/EnumerationHistory.java (100%)
 copy flink/{v1.16 => v1.15}/flink/src/test/java/org/apache/iceberg/flink/source/enumerator/TestEnumerationHistory.java (100%)