You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Dian Fu (Jira)" <ji...@apache.org> on 2020/02/04 08:15:00 UTC

[jira] [Created] (FLINK-15897) Deserialize the Python UDF execution results when sending them out

Dian Fu created FLINK-15897:
-------------------------------

             Summary: Deserialize the Python UDF execution results when sending them out
                 Key: FLINK-15897
                 URL: https://issues.apache.org/jira/browse/FLINK-15897
             Project: Flink
          Issue Type: Improvement
          Components: API / Python
            Reporter: Dian Fu
            Assignee: Dian Fu
             Fix For: 1.11.0


Currently, the Python UDF execution results are deserialized and then buffered in a collection when received from the Python worker. The deserialization could be deferred when sending the execution results to the downstream operator. That's to say, it buffers the serialized bytes instead of the deserialized Java objects in the buffer. This could reduce the memory footprint of the Java operator.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)