You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Hequn Cheng (Jira)" <ji...@apache.org> on 2020/02/06 11:29:00 UTC

[jira] [Closed] (FLINK-15897) Defer the deserialization of the Python UDF execution results

     [ https://issues.apache.org/jira/browse/FLINK-15897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hequn Cheng closed FLINK-15897.
-------------------------------
    Resolution: Resolved

> Defer the deserialization of the Python UDF execution results
> -------------------------------------------------------------
>
>                 Key: FLINK-15897
>                 URL: https://issues.apache.org/jira/browse/FLINK-15897
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / Python
>            Reporter: Dian Fu
>            Assignee: Dian Fu
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.11.0
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Currently, the Python UDF execution results are deserialized and then buffered in a collection when received from the Python worker. The deserialization could be deferred when sending the execution results to the downstream operator. That's to say, it buffers the serialized bytes instead of the deserialized Java objects in the buffer. This could reduce the memory footprint of the Java operator.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)