[jira] [Updated] (FLINK-36769) Suport fury Serializer for pyflink

["xingyuan cheng (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-36769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

xingyuan cheng updated FLINK-36769:
-----------------------------------
    External issue URL: https://github.com/apache/flink/pull/25672

> Suport fury Serializer for pyflink
> ----------------------------------
>
>                 Key: FLINK-36769
>                 URL: https://issues.apache.org/jira/browse/FLINK-36769
>             Project: Flink
>          Issue Type: New Feature
>          Components: API / Python
>    Affects Versions: 1.16.1
>            Reporter: xingyuan cheng
>            Priority: Major
>
> Hi, community. Currently, in the batch verification scenario of our algorithm data, we use pyflink and encounter low transmission efficiency caused by low performance of pickle4-based encoding. After research, we decided to adopt Apache fury, a serialization framework based on pickle5 encoding. The implementation of fury in python will define the transmission buffer size in the protocol for transmission to improve the performance of large data transmission. To this end, I Prepared a draft pull request. What do friends in the community think about this?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)