You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2019/10/09 08:38:00 UTC
[jira] [Updated] (FLINK-14254) Introduce FileSystemOutputFormat for
batch
[ https://issues.apache.org/jira/browse/FLINK-14254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jingsong Lee updated FLINK-14254:
---------------------------------
Description:
Introduce FileSystemOutputFormat to support all table file system connector with partition support in batch mode.
FileSystemOutputFormat use PartitionWriter to write:
# DynamicPartitionWriter
# GroupedPartitionWriter
# NonPartitionWriter
FileSystemOutputFormat use FileCommitter to commit temporary files.
was:
Introduce BatchFileSystemSink to support all table file system connector with partition support.
BatchFileSystemSink use PartitionWriter to write:
# DynamicPartitionWriter
# GroupedPartitionWriter
# NonPartitionWriter
BatchFileSystemSink use FileCommitter to commit temporary files.
> Introduce FileSystemOutputFormat for batch
> ------------------------------------------
>
> Key: FLINK-14254
> URL: https://issues.apache.org/jira/browse/FLINK-14254
> Project: Flink
> Issue Type: Sub-task
> Components: Table SQL / Planner
> Reporter: Jingsong Lee
> Assignee: Jingsong Lee
> Priority: Major
>
> Introduce FileSystemOutputFormat to support all table file system connector with partition support in batch mode.
> FileSystemOutputFormat use PartitionWriter to write:
> # DynamicPartitionWriter
> # GroupedPartitionWriter
> # NonPartitionWriter
> FileSystemOutputFormat use FileCommitter to commit temporary files.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)