You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Gabor Somogyi (Jira)" <ji...@apache.org> on 2023/11/10 08:34:00 UTC

[jira] [Created] (FLINK-33515) PythonDriver need to stream python process output to log instead of collecting it in memory

Gabor Somogyi created FLINK-33515:
-------------------------------------

             Summary: PythonDriver need to stream python process output to log instead of collecting it in memory
                 Key: FLINK-33515
                 URL: https://issues.apache.org/jira/browse/FLINK-33515
             Project: Flink
          Issue Type: Bug
          Components: API / Python
    Affects Versions: 1.19.0
            Reporter: Gabor Somogyi


PythonDriver now collects the python process output in a Stringbuilder instead of streaming it. It can cause OOM when the python process is generating huge amount of output.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)