You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Roshan Naik (JIRA)" <ji...@apache.org> on 2015/12/03 23:43:11 UTC

[jira] [Commented] (FLINK-2583) Add Stream Sink For Rolling HDFS Files

    [ https://issues.apache.org/jira/browse/FLINK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038752#comment-15038752 ] 

Roshan Naik commented on FLINK-2583:
------------------------------------

Would like to point out that this  truncate mechanism will only work with a very limited set of file formats.. such as text files. it wont work with most file formats such as compressed, avro  or columnar formats

> Add Stream Sink For Rolling HDFS Files
> --------------------------------------
>
>                 Key: FLINK-2583
>                 URL: https://issues.apache.org/jira/browse/FLINK-2583
>             Project: Flink
>          Issue Type: New Feature
>          Components: Streaming
>            Reporter: Aljoscha Krettek
>            Assignee: Aljoscha Krettek
>             Fix For: 0.10.0
>
>
> In addition to having configurable file-rolling behavior the Sink should also integrate with checkpointing to make it possible to have exactly-once semantics throughout the topology.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)