You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Elias Levy (JIRA)" <ji...@apache.org> on 2019/03/02 07:29:00 UTC

[jira] [Created] (FLINK-11794) Allow compression of row format files created by StreamingFileSink

Elias Levy created FLINK-11794:
----------------------------------

             Summary: Allow compression of row format files created by StreamingFileSink
                 Key: FLINK-11794
                 URL: https://issues.apache.org/jira/browse/FLINK-11794
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / FileSystem
    Affects Versions: 1.7.2
            Reporter: Elias Levy


Currently, there is no mechanism to compress files created using a StreamingFileSink.  This is highly desirable when output is a text based row format such as JSON.

Possible alternatives are the introduction of a callback that gets passed the local file before it is uploaded to the DFS, so that it could be compressed; or a factory method could be used that returns an OutputStream, such as GZIPOutputStream, that compresses a passed in output stream that could be then used by the Encoder.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)