You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Lakshmi Rao (JIRA)" <ji...@apache.org> on 2018/04/02 21:03:00 UTC
[jira] [Commented] (FLINK-9115) Support addition of part suffix in
BucketingSink
[ https://issues.apache.org/jira/browse/FLINK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423131#comment-16423131 ]
Lakshmi Rao commented on FLINK-9115:
------------------------------------
I see a similar ask on this thread here earlier this year: https://stackoverflow.com/questions/48204520/how-to-add-suffix-to-final-completed-file-generated-by-bucketingsink-in-apache-f?rq=1
> Support addition of part suffix in BucketingSink
> ------------------------------------------------
>
> Key: FLINK-9115
> URL: https://issues.apache.org/jira/browse/FLINK-9115
> Project: Flink
> Issue Type: Improvement
> Components: filesystem-connector
> Reporter: Lakshmi Rao
> Priority: Minor
> Labels: usability
>
> Currently the BucketingSink allows addition of part prefix, pending prefix/suffix and in-progress prefix/suffix via setter methods. Can we also support setting part suffixes?
> An instance where this maybe useful: I am currently writing GZIP compressed output to S3 using the BucketingSink and I would want the uploaded files to have a ".gz" or ".zip" extensions . An easy way to do this would be by setting a part file suffix with the required file extension.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)