You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@flink.apache.org by lz...@apache.org on 2020/06/09 05:48:20 UTC

[flink] branch master updated (74231f7 -> 45f42f8)

This is an automated email from the ASF dual-hosted git repository.

lzljs3620320 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.


    from 74231f7  [FLINK-17902][python] Support the new interfaces about temporary functions in PyFlink
     add 45f42f8  [FLINK-18056][fs-connector] Hadoop path-based file writer adds UUID to in-progress file to avoid conflicts

No new revisions were added by this update.

Summary of changes:
 flink-formats/flink-hadoop-bulk/pom.xml            |  37 ++++++
 .../bulk/DefaultHadoopFileCommitterFactory.java    |  16 ++-
 .../formats/hadoop/bulk/HadoopFileCommitter.java   |   2 +-
 .../hadoop/bulk/HadoopFileCommitterFactory.java    |  18 ++-
 .../hadoop/bulk/HadoopPathBasedPartFileWriter.java |  59 ++++++---
 .../bulk/committer/HadoopRenameFileCommitter.java  |  41 +++++--
 ...terTest.java => AbstractFileCommitterTest.java} | 132 +++++++++++++--------
 .../bulk/HadoopPathBasedPartFileWriterTest.java    |   6 +-
 .../committer/HadoopRenameCommitterHDFSTest.java   |  97 +++++++++++++++
 .../HadoopRenameCommitterLocalFSTest.java          |  69 +++++++++++
 .../bulk/committer/cluster/HDFSCluster.java}       |  40 ++++---
 11 files changed, 414 insertions(+), 103 deletions(-)
 rename flink-formats/flink-hadoop-bulk/src/test/java/org/apache/flink/formats/hadoop/bulk/{committer/HadoopRenameFileCommitterTest.java => AbstractFileCommitterTest.java} (66%)
 create mode 100644 flink-formats/flink-hadoop-bulk/src/test/java/org/apache/flink/formats/hadoop/bulk/committer/HadoopRenameCommitterHDFSTest.java
 create mode 100644 flink-formats/flink-hadoop-bulk/src/test/java/org/apache/flink/formats/hadoop/bulk/committer/HadoopRenameCommitterLocalFSTest.java
 copy flink-formats/flink-hadoop-bulk/src/{main/java/org/apache/flink/formats/hadoop/bulk/HadoopFileCommitterFactory.java => test/java/org/apache/flink/formats/hadoop/bulk/committer/cluster/HDFSCluster.java} (56%)