You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@iceberg.apache.org by bl...@apache.org on 2022/03/13 17:48:47 UTC
[iceberg] branch master updated (a555556 -> 5c4dbbb)

This is an automated email from the ASF dual-hosted git repository.

blue pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git.


    from a555556  Spark: Use withNullability instead of a new AttributeRef (#4133)
     add 5c4dbbb  Flink: Add FLIP-27 split assigner (#4270)

No new revisions were added by this update.

Summary of changes:
 .../flink/source/assigner/GetSplitResult.java      |  81 +++++++++++++
 .../flink/source/assigner/SimpleSplitAssigner.java | 100 ++++++++++++++++
 .../assigner/SimpleSplitAssignerFactory.java       |  21 ++--
 .../flink/source/assigner/SplitAssigner.java       | 111 ++++++++++++++++++
 .../source/assigner/SplitAssignerFactory.java      |  12 +-
 .../source/split/IcebergSourceSplitState.java      |  21 ++--
 .../source/split/IcebergSourceSplitStatus.java     |   8 +-
 .../source/assigner/TestSimpleSplitAssigner.java   | 127 +++++++++++++++++++++
 8 files changed, 453 insertions(+), 28 deletions(-)
 create mode 100644 flink/v1.14/flink/src/main/java/org/apache/iceberg/flink/source/assigner/GetSplitResult.java
 create mode 100644 flink/v1.14/flink/src/main/java/org/apache/iceberg/flink/source/assigner/SimpleSplitAssigner.java
 copy api/src/main/java/org/apache/iceberg/CombinedScanTask.java => flink/v1.14/flink/src/main/java/org/apache/iceberg/flink/source/assigner/SimpleSplitAssignerFactory.java (61%)
 create mode 100644 flink/v1.14/flink/src/main/java/org/apache/iceberg/flink/source/assigner/SplitAssigner.java
 copy api/src/main/java/org/apache/iceberg/Accessor.java => flink/v1.14/flink/src/main/java/org/apache/iceberg/flink/source/assigner/SplitAssignerFactory.java (71%)
 copy arrow/src/main/java/org/apache/iceberg/arrow/ArrowAllocation.java => flink/v1.14/flink/src/main/java/org/apache/iceberg/flink/source/split/IcebergSourceSplitState.java (65%)
 copy api/src/main/java/org/apache/iceberg/SortDirection.java => flink/v1.14/flink/src/main/java/org/apache/iceberg/flink/source/split/IcebergSourceSplitStatus.java (86%)
 create mode 100644 flink/v1.14/flink/src/test/java/org/apache/iceberg/flink/source/assigner/TestSimpleSplitAssigner.java