You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jiang Xin (Jira)" <ji...@apache.org> on 2024/01/02 02:40:00 UTC

[jira] [Created] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0

Jiang Xin created FLINK-33961:
---------------------------------

             Summary: Hybrid Shuffle may hang when exclusive buffers per channel is set to 0
                 Key: FLINK-33961
                 URL: https://issues.apache.org/jira/browse/FLINK-33961
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Network
            Reporter: Jiang Xin


I found that the Hybrid Shuffle without enabling new mode may hang when exclusive-buffers-per-channel is set to 0. It can be reproduced by adding the following test into 
HybridShuffleITCase.java and run it.
{code:java}
@RepeatedTest(10)
void testHybridFullExchangesWithNonBuffersPerChannel() throws Exception {
    final int numRecordsToSend = 10000;
    Configuration configuration = configureHybridOptions(getConfiguration(), false);
    configuration.set(
            NettyShuffleEnvironmentOptions.NETWORK_HYBRID_SHUFFLE_ENABLE_NEW_MODE, false);
    configuration.set(NETWORK_BUFFERS_PER_CHANNEL, 0);
    JobGraph jobGraph = createJobGraph(numRecordsToSend, false, configuration);
    executeJob(jobGraph, configuration, numRecordsToSend);
} {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)