You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Xintong Song (Jira)" <ji...@apache.org> on 2022/11/08 04:10:00 UTC

[jira] [Commented] (FLINK-29923) Hybrid Shuffle may face deadlock when running a task need to execute big size data

    [ https://issues.apache.org/jira/browse/FLINK-29923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630168#comment-17630168 ] 

Xintong Song commented on FLINK-29923:
--------------------------------------

Thanks for reporting this, [~AlexXXX].

[~Weijie Guo], could you take a look at this?

> Hybrid Shuffle may face deadlock when running a task need to execute big size data
> ----------------------------------------------------------------------------------
>
>                 Key: FLINK-29923
>                 URL: https://issues.apache.org/jira/browse/FLINK-29923
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Network
>    Affects Versions: 1.16.0
>            Reporter: AlexHu
>            Priority: Major
>         Attachments: 性能差距.png, 死锁2-select.png, 死锁检测.png
>
>
> The flink 1.16 offers hybrid shuffle to combine the superiority of blocking shuffle and pipeline shuffle. But when I want to test this new feature I face a problem that it may cause deadlock when it running. 
> Actually, it will run well at beginning. However, when it runs to a certain number it may failure for the buffer size and if I set a bigger size it may running without data execution like the picture. So I want to ask the cause of this problem and a solution.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)