You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2021/11/18 10:26:00 UTC

[jira] [Created] (FLINK-24954) Reset read buffer request timeout on buffer recycling for sort-shuffle

Yingjie Cao created FLINK-24954:
-----------------------------------

             Summary: Reset read buffer request timeout on buffer recycling for sort-shuffle
                 Key: FLINK-24954
                 URL: https://issues.apache.org/jira/browse/FLINK-24954
             Project: Flink
          Issue Type: Sub-task
          Components: Runtime / Network
            Reporter: Yingjie Cao
             Fix For: 1.15.0


Currently, the read buffer request timeout implementation of sort-shuffle is a little aggressive. As reported in the mailing list: [https://lists.apache.org/thread/bd3s5bqfg9oxlb1g1gg3pxs3577lhf88]. The TimeoutException may be triggered if there is data skew and the downstream task is slow. Actually, we can further improve this case by reseting the request timeout on buffer recycling.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)