You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2020/11/26 17:12:01 UTC

[jira] [Commented] (BEAM-11113) Default compressor change breaks dataflow python streaming job update compatibility

    [ https://issues.apache.org/jira/browse/BEAM-11113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239358#comment-17239358 ] 

Beam JIRA Bot commented on BEAM-11113:
--------------------------------------

This issue is assigned but has not received an update in 30 days so it has been labeled "stale-assigned". If you are still working on the issue, please give an update and remove the label. If you are no longer working on the issue, please unassign so someone else may work on it. In 7 days the issue will be automatically unassigned.

> Default compressor change breaks dataflow python streaming job update compatibility
> -----------------------------------------------------------------------------------
>
>                 Key: BEAM-11113
>                 URL: https://issues.apache.org/jira/browse/BEAM-11113
>             Project: Beam
>          Issue Type: Bug
>          Components: sdk-py-core
>    Affects Versions: 2.24.0, 2.25.0
>            Reporter: Yichi Zhang
>            Assignee: Yichi Zhang
>            Priority: P2
>              Labels: stale-assigned
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> The default pickler compressor switched from zlib to bz2 in https://github.com/apache/beam/commit/103facbf80c2e4786e60367161ec59352196d04a#diff-c0972fb2e432f61d6dd354ca320853c520d0b414bb0113e375e1b077c8ec785c, this will change the pickled Coder representations in the job graph and lead to pipeline update failure on Dataflow.
> Sdk versions using bz2 in Coder pickler may not be update-able to future sdk versions on dataflow.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)