You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jiang Xin (Jira)" <ji...@apache.org> on 2024/01/02 02:40:00 UTC
[jira] [Created] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0
Jiang Xin created FLINK-33961:
---------------------------------
Summary: Hybrid Shuffle may hang when exclusive buffers per channel is set to 0
Key: FLINK-33961
URL: https://issues.apache.org/jira/browse/FLINK-33961
Project: Flink
Issue Type: Bug
Components: Runtime / Network
Reporter: Jiang Xin
I found that the Hybrid Shuffle without enabling new mode may hang when exclusive-buffers-per-channel is set to 0. It can be reproduced by adding the following test into
HybridShuffleITCase.java and run it.
{code:java}
@RepeatedTest(10)
void testHybridFullExchangesWithNonBuffersPerChannel() throws Exception {
final int numRecordsToSend = 10000;
Configuration configuration = configureHybridOptions(getConfiguration(), false);
configuration.set(
NettyShuffleEnvironmentOptions.NETWORK_HYBRID_SHUFFLE_ENABLE_NEW_MODE, false);
configuration.set(NETWORK_BUFFERS_PER_CHANNEL, 0);
JobGraph jobGraph = createJobGraph(numRecordsToSend, false, configuration);
executeJob(jobGraph, configuration, numRecordsToSend);
} {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)