You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@iceberg.apache.org by st...@apache.org on 2023/04/06 15:11:53 UTC

[iceberg] branch master updated (7c61537194 -> a648533a84)

This is an automated email from the ASF dual-hosted git repository.

stevenwu pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/iceberg.git


    from 7c61537194 Core: Fix flakiness in HadoopFileIOTest (#7253)
     add a648533a84 Flink: Data statistics operator sends local data statistics to coordinator and receive aggregated data statistics from coordinator for smart shuffling (#7269)

No new revisions were added by this update.

Summary of changes:
 .../shuffle/DataStatisticsEvent.java}              | 40 +++++++----
 .../flink/sink/shuffle/DataStatisticsOperator.java | 20 ++++--
 .../sink/shuffle/TestDataStatisticsOperator.java   | 83 ++++++++++++++++++++--
 3 files changed, 117 insertions(+), 26 deletions(-)
 copy flink/v1.16/flink/src/main/java/org/apache/iceberg/flink/{source/FlinkInputSplit.java => sink/shuffle/DataStatisticsEvent.java} (52%)