You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2022/08/03 06:41:00 UTC
[jira] [Created] (FLINK-28785) Hybrid shuffle consumer thread and upstream thread may have dead lock
Weijie Guo created FLINK-28785:
----------------------------------
Summary: Hybrid shuffle consumer thread and upstream thread may have dead lock
Key: FLINK-28785
URL: https://issues.apache.org/jira/browse/FLINK-28785
Project: Flink
Issue Type: Bug
Components: Runtime / Network
Reporter: Weijie Guo
Fix For: 1.16.0
In hybrid shuffle mode, subpartition view lock will be acquired by consumer thread, and further acquire the read lock of MemoryDataManager. But MemoryDataManager may acquire write lock to make a global spilling decision, and then wait subpartition view lock to get consuming offset. In this case, deadlock will occurs.
consumer thread : acqurie subpartition lock -> wait read lock.
upstream thread: acquire write lock -> wait subpartition lock.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)