You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Yingjie Cao (Jira)" <ji...@apache.org> on 2022/01/16 09:02:00 UTC

[jira] [Commented] (FLINK-24954) Reset read buffer request timeout on buffer recycling for sort-shuffle

    [ https://issues.apache.org/jira/browse/FLINK-24954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476755#comment-17476755 ] 

Yingjie Cao commented on FLINK-24954:
-------------------------------------

Fixed via:

3e206f088763dd7b96eeddf744c4e8370b2788d5 on master

936f1d76b3cf494cc98c0c81bb5acfe5b438d93d on 1.14

 

> Reset read buffer request timeout on buffer recycling for sort-shuffle
> ----------------------------------------------------------------------
>
>                 Key: FLINK-24954
>                 URL: https://issues.apache.org/jira/browse/FLINK-24954
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Runtime / Network
>            Reporter: Yingjie Cao
>            Assignee: Yuxin Tan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.15.0, 1.14.4
>
>
> Currently, the read buffer request timeout implementation of sort-shuffle is a little aggressive. As reported in the mailing list: [https://lists.apache.org/thread/bd3s5bqfg9oxlb1g1gg3pxs3577lhf88]. The TimeoutException may be triggered if there is data skew and the downstream task is slow. Actually, we can further improve this case by reseting the request timeout on buffer recycling.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)