You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@iceberg.apache.org by st...@apache.org on 2024/07/29 22:35:23 UTC

(iceberg) branch main updated (e0a464f1cf -> f7585932a6)

This is an automated email from the ASF dual-hosted git repository.

stevenwu pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/iceberg.git


    from e0a464f1cf Flink: improve snapshot compatibility check by comparing projected sort schema in SortKeySerializer. also add unit tests for serializer snapshot. (#10794)
     add f7585932a6 Flink: support limit pushdown in FLIP-27 source (#10748)

No new revisions were added by this update.

Summary of changes:
 .../apache/iceberg/flink/source/IcebergSource.java |  3 +-
 .../source/reader/LimitableDataIterator.java}      | 41 +++++++----
 .../iceberg/flink/source/reader/RecordLimiter.java | 30 ++++----
 .../flink/source/reader/RowDataReaderFunction.java | 40 ++++++++++-
 .../flink/source/TestFlinkSourceConfig.java        |  7 +-
 .../source/reader/TestLimitableDataIterator.java   | 84 ++++++++++++++++++++++
 6 files changed, 171 insertions(+), 34 deletions(-)
 copy flink/{v1.17/flink/src/main/java/org/apache/iceberg/flink/source/reader/DataIteratorReaderFunction.java => v1.19/flink/src/main/java/org/apache/iceberg/flink/source/reader/LimitableDataIterator.java} (50%)
 copy core/src/test/java/org/apache/iceberg/util/FakeTicker.java => flink/v1.19/flink/src/main/java/org/apache/iceberg/flink/source/reader/RecordLimiter.java (62%)
 create mode 100644 flink/v1.19/flink/src/test/java/org/apache/iceberg/flink/source/reader/TestLimitableDataIterator.java