You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yuxin Tan (Jira)" <ji...@apache.org> on 2021/11/26 08:07:00 UTC

[jira] [Commented] (FLINK-24954) Reset read buffer request timeout on buffer recycling for sort-shuffle

    [ https://issues.apache.org/jira/browse/FLINK-24954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17449442#comment-17449442 ] 

Yuxin Tan commented on FLINK-24954:
-----------------------------------

Thanks [~kevin.cyj] for assigning the issue to me, I will take a look and submit a PR recently.

> Reset read buffer request timeout on buffer recycling for sort-shuffle
> ----------------------------------------------------------------------
>
>                 Key: FLINK-24954
>                 URL: https://issues.apache.org/jira/browse/FLINK-24954
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Network
>            Reporter: Yingjie Cao
>            Assignee: Yuxin Tan
>            Priority: Major
>             Fix For: 1.15.0
>
>
> Currently, the read buffer request timeout implementation of sort-shuffle is a little aggressive. As reported in the mailing list: [https://lists.apache.org/thread/bd3s5bqfg9oxlb1g1gg3pxs3577lhf88]. The TimeoutException may be triggered if there is data skew and the downstream task is slow. Actually, we can further improve this case by reseting the request timeout on buffer recycling.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)