You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Jiayi Liao (Jira)" <ji...@apache.org> on 2020/08/28 02:44:00 UTC

[jira] [Created] (FLINK-19069) finalizeOnMaster takes too much time and client timeouts

Jiayi Liao created FLINK-19069:
----------------------------------

             Summary: finalizeOnMaster takes too much time and client timeouts
                 Key: FLINK-19069
                 URL: https://issues.apache.org/jira/browse/FLINK-19069
             Project: Flink
          Issue Type: Improvement
          Components: Runtime / Task
    Affects Versions: 1.9.0
            Reporter: Jiayi Liao


Currently we execute {{finalizeOnMaster}} in JM's main thread, which may stuck the JM for a very long time and client timeouts eventually. 

For example, we'd like to write data to HDFS  and commit files on JM, which takes more than ten minutes to commit tens of thousands files.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)