You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by xt...@apache.org on 2023/01/10 02:13:30 UTC
[flink] branch master updated (0f14f13122e -> c8ecfadfb96)
This is an automated email from the ASF dual-hosted git repository.
xtsong pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
from 0f14f13122e [FLINK-28742][python] Fix ArrowUtils to support CHAR type
add c8ecfadfb96 [FLINK-30128][fs][azure] ABFS support in streaming sink
No new revisions were added by this update.
Summary of changes:
flink-filesystems/flink-azure-fs-hadoop/pom.xml | 7 -
.../flink/fs/azurefs/AbstractAzureFSFactory.java | 3 +-
.../flink/fs/azurefs/AzureBlobFileSystem.java | 34 +--
.../AzureBlobFsRecoverableDataOutputStream.java | 304 +++++++++++++++++++++
.../fs/azurefs/AzureBlobRecoverableWriter.java | 67 +++++
.../fs/azurefs/AzureBlobRecoverableWriterTest.java | 100 +++++++
...BaseHadoopFsRecoverableFsDataOutputStream.java} | 71 +++--
.../flink/runtime/fs/hdfs/HadoopFsRecoverable.java | 8 +-
.../hdfs/HadoopRecoverableFsDataOutputStream.java | 51 +---
.../runtime/fs/hdfs/HadoopRecoverableWriter.java | 13 +-
10 files changed, 548 insertions(+), 110 deletions(-)
copy flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/HadoopFileSystemFactory.java => flink-filesystems/flink-azure-fs-hadoop/src/main/java/org/apache/flink/fs/azurefs/AzureBlobFileSystem.java (53%)
create mode 100644 flink-filesystems/flink-azure-fs-hadoop/src/main/java/org/apache/flink/fs/azurefs/AzureBlobFsRecoverableDataOutputStream.java
create mode 100644 flink-filesystems/flink-azure-fs-hadoop/src/main/java/org/apache/flink/fs/azurefs/AzureBlobRecoverableWriter.java
create mode 100644 flink-filesystems/flink-azure-fs-hadoop/src/test/java/org/apache/flink/fs/azurefs/AzureBlobRecoverableWriterTest.java
copy flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/fs/hdfs/{HadoopDataOutputStream.java => BaseHadoopFsRecoverableFsDataOutputStream.java} (51%)