You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Weijie Guo (Jira)" <ji...@apache.org> on 2024/01/02 07:16:00 UTC
[jira] [Closed] (FLINK-33961) Hybrid Shuffle may hang when exclusive buffers per channel is set to 0
[ https://issues.apache.org/jira/browse/FLINK-33961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Weijie Guo closed FLINK-33961.
------------------------------
Resolution: Invalid
> Hybrid Shuffle may hang when exclusive buffers per channel is set to 0
> ----------------------------------------------------------------------
>
> Key: FLINK-33961
> URL: https://issues.apache.org/jira/browse/FLINK-33961
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Reporter: Jiang Xin
> Priority: Major
>
> I found that the Hybrid Shuffle without enabling new mode may hang when exclusive-buffers-per-channel is set to 0. It can be reproduced by adding the following test into `HybridShuffleITCase.java` and running it.
> {code:java}
> @RepeatedTest(10)
> void testHybridFullExchangesWithNonBuffersPerChannel() throws Exception {
> final int numRecordsToSend = 10000;
> Configuration configuration = configureHybridOptions(getConfiguration(), false);
> configuration.set(
> NettyShuffleEnvironmentOptions.NETWORK_HYBRID_SHUFFLE_ENABLE_NEW_MODE, false);
> configuration.set(NETWORK_BUFFERS_PER_CHANNEL, 0);
> JobGraph jobGraph = createJobGraph(numRecordsToSend, false, configuration);
> executeJob(jobGraph, configuration, numRecordsToSend);
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)