You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Yun Gao (Jira)" <ji...@apache.org> on 2020/08/06 09:28:00 UTC
[jira] [Commented] (FLINK-11928) Create a Compression string writer
for flink-connectors-filesystem
[ https://issues.apache.org/jira/browse/FLINK-11928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172162#comment-17172162 ]
Yun Gao commented on FLINK-11928:
---------------------------------
Hello, since this issue targets at add the compression writer for the BucketingSink, however, currently we are on the road to replace the BucketingSink with the StreamingFileSink, and we already have the implementation of compression writer for the StreamingFileSink as mentioned above, I think we could currently close this issue?
> Create a Compression string writer for flink-connectors-filesystem
> ------------------------------------------------------------------
>
> Key: FLINK-11928
> URL: https://issues.apache.org/jira/browse/FLINK-11928
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / FileSystem
> Affects Versions: 1.6.3, 1.7.2
> Reporter: Shengnan YU
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Flink does not provided a API for writer compressed string text file to filesystem. I have implemented a simple CompressionStringWriter can compressed the stream and write to the FS. The default writing is to call toString() method for element and separate them by newline. Extending this class and override write() method can make custom writting.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)