You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Aljoscha Krettek (JIRA)" <ji...@apache.org> on 2015/09/18 18:59:04 UTC
[jira] [Assigned] (FLINK-2706) Add support for streaming
RollingFileSink to truncate / append on UNIX file systems
[ https://issues.apache.org/jira/browse/FLINK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aljoscha Krettek reassigned FLINK-2706:
---------------------------------------
Assignee: Aljoscha Krettek
> Add support for streaming RollingFileSink to truncate / append on UNIX file systems
> -----------------------------------------------------------------------------------
>
> Key: FLINK-2706
> URL: https://issues.apache.org/jira/browse/FLINK-2706
> Project: Flink
> Issue Type: Improvement
> Components: Streaming Connectors
> Affects Versions: 0.10
> Reporter: Stephan Ewen
> Assignee: Aljoscha Krettek
>
> Efficient exactly-once behavior needs the filesystem to support appending and truncating files.
> Since the UNIX file system API allows to append files and truncate files, we can support perfect exactly-once behavior efficiently on all file systems that expose a UNIX / POSIX-style interface (local FS, NFS, MapR FS).
> Without this support, only Hadoop 2.7+ versions support proper exactly once behavior.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)