You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@flink.apache.org by ja...@apache.org on 2023/01/31 03:09:40 UTC

[flink] branch master updated (0aab2cd369e -> cf358d7d55c)

This is an automated email from the ASF dual-hosted git repository.

jark pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git


    from 0aab2cd369e [FLINK-30477][datastream] Fix AsyncWaitOperator that not properly blocking retries when timeout occurs (#21546)
     add cf358d7d55c [FLINK-29880][hive] Introduce auto compaction for Hive sink in batch mode (#21703)

No new revisions were added by this update.

Summary of changes:
 .../docs/connectors/table/hive/hive_read_write.md  |  63 +++++
 .../docs/connectors/table/hive/hive_read_write.md  |  64 +++++
 .../file/table/FileSystemConnectorOptions.java     |   8 +
 .../connector/file/table/batch/BatchSink.java      | 121 +++++++++
 .../batch/compact/BatchCompactCoordinator.java     |   4 +-
 .../table/batch/compact/BatchCompactOperator.java  |   1 +
 .../file/table/stream/compact/CompactOperator.java | 121 ++-------
 .../{batch/compact => utils}/CompactFileUtils.java |  56 ++++-
 .../connectors/hive/HiveDynamicTableFactory.java   |   4 +-
 .../apache/flink/connectors/hive/HiveOptions.java  |   9 +
 .../flink/connectors/hive/HiveTableSink.java       | 277 ++++++++++++++++-----
 .../hive/HiveTableCompactSinkITCase.java           | 209 ++++++++++++++++
 12 files changed, 758 insertions(+), 179 deletions(-)
 create mode 100644 flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/batch/BatchSink.java
 rename flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/{batch/compact => utils}/CompactFileUtils.java (68%)
 create mode 100644 flink-connectors/flink-connector-hive/src/test/java/org/apache/flink/connectors/hive/HiveTableCompactSinkITCase.java