You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2023/03/12 06:38:00 UTC

[jira] [Comment Edited] (FLINK-31393) HsFileDataManager use an incorrect default timeout

    [ https://issues.apache.org/jira/browse/FLINK-31393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17699217#comment-17699217 ] 

Weijie Guo edited comment on FLINK-31393 at 3/12/23 6:37 AM:
-------------------------------------------------------------

release-1.17 via 02814d686592950b1b47b152cceca308d805af80.
master(1.18) via b63c65a10bc76b4dadd6ae17305ee1941b773601.


was (Author: weijie guo):
release-1.17 via 02814d686592950b1b47b152cceca308d805af80.

> HsFileDataManager use an incorrect default timeout
> --------------------------------------------------
>
>                 Key: FLINK-31393
>                 URL: https://issues.apache.org/jira/browse/FLINK-31393
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Network
>    Affects Versions: 1.17.0, 1.16.1
>            Reporter: Weijie Guo
>            Assignee: Weijie Guo
>            Priority: Critical
>              Labels: pull-request-available
>             Fix For: 1.17.0
>
>
> For batch shuffle(i.e. hybrid shuffle & sort-merge shuffle), If there is a fierce contention of the batch shuffle read memory, it will throw a {{TimeoutException}} to fail downstream task to release memory. But for hybrid shuffle, It uses an incorrect default timeout(5ms), this will make the job very easy to fail.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)