You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Hangxiang Yu (Jira)" <ji...@apache.org> on 2022/07/19 06:44:00 UTC

[jira] [Updated] (FLINK-28602) Changelog cannot close stream normally while enabling compression

     [ https://issues.apache.org/jira/browse/FLINK-28602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hangxiang Yu updated FLINK-28602:
---------------------------------
    Description: 
While enabling compression, Changelog part will wrap output stream using   

StreamCompressionDecorator#decorateWithCompression.

As the comment said, "IMPORTANT: For streams returned by this method, \{@link OutputStream#close()} is not propagated to the inner stream. The inner stream must be closed separately.".

But StateChangeFsUploader will not close inner stream if wrapped stream has been closed.

So the upload may not complete when enabling compression even if it returns success.

  was:
While enabling compression, Changelog part will wrap output stream using   

StreamCompressionDecorator#decorateWithCompression.

As the comment said, "IMPORTANT: For streams returned by this method, \{@link OutputStream#close()} is not propagated to the inner stream. The inner stream must be closed separately.".

But StateChangeFsUploader will not close inner stream if wrapped stream has been closed.

So the upload will not complete when enabling compression even if it returns success.


> Changelog cannot close stream normally while enabling compression
> -----------------------------------------------------------------
>
>                 Key: FLINK-28602
>                 URL: https://issues.apache.org/jira/browse/FLINK-28602
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / State Backends
>    Affects Versions: 1.15.1, 1.16.0
>            Reporter: Hangxiang Yu
>            Priority: Major
>             Fix For: 1.16.0, 1.15.2
>
>
> While enabling compression, Changelog part will wrap output stream using   
> StreamCompressionDecorator#decorateWithCompression.
> As the comment said, "IMPORTANT: For streams returned by this method, \{@link OutputStream#close()} is not propagated to the inner stream. The inner stream must be closed separately.".
> But StateChangeFsUploader will not close inner stream if wrapped stream has been closed.
> So the upload may not complete when enabling compression even if it returns success.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)