You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Rion Williams (Jira)" <ji...@apache.org> on 2026/01/22 21:05:00 UTC
[jira] [Comment Edited] (FLINK-38783) Caused by: java.util.ConcurrentModificationException
[ https://issues.apache.org/jira/browse/FLINK-38783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18053691#comment-18053691 ]
Rion Williams edited comment on FLINK-38783 at 1/22/26 9:04 PM:
----------------------------------------------------------------
I was able to reproduce this issue within a series of tests that introduced concurrency. I'm happy to take the issue and implement a fix for it.
*Update:* I've gone ahead and issued a pull request with the appropriate fix to improve concurrency along with a suite of tests to confirm the expected behavior as well.
* https://github.com/apache/flink/pull/27459
was (Author: rionmonster):
I was able to reproduce this issue within a series of tests that introduced concurrency. I'm happy to take the issue and implement a fix for it.
> Caused by: java.util.ConcurrentModificationException
> ----------------------------------------------------
>
> Key: FLINK-38783
> URL: https://issues.apache.org/jira/browse/FLINK-38783
> Project: Flink
> Issue Type: Bug
> Affects Versions: 1.20.3
> Environment: flink 1.20.3
> hadoop 3.3.6
> Reporter: huyuliang
> Priority: Critical
> Labels: bug
>
> Occasionally occurs, but no way to stably trigger it has been found.
> Caused by: java.util.ConcurrentModificationException
> at java.base/java.util.HashMap.computeIfAbsent(HashMap.java:1298) ~[?:?]
> at org.apache.flink.runtime.io.network.partition.hybrid.tiered.storage.TieredStorageResourceRegistry.registerResource(TieredStorageResourceRegistry.java:46) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty.TieredStorageNettyServiceImpl.lambda$registerProducer$1(TieredStorageNettyServiceImpl.java:80) ~[flink-dist-1.20.3.jar:1.20.3]
> at java.base/java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1737) ~[?:?]
> at org.apache.flink.runtime.io.network.partition.hybrid.tiered.netty.TieredStorageNettyServiceImpl.registerProducer(TieredStorageNettyServiceImpl.java:76) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory.MemoryTierProducerAgent.<init>(MemoryTierProducerAgent.java:100) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.memory.MemoryTierFactory.createProducerAgent(MemoryTierFactory.java:114) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.partition.hybrid.tiered.shuffle.TieredResultPartitionFactory.createTierProducerAgentsAndMemorySpecs(TieredResultPartitionFactory.java:227) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.partition.hybrid.tiered.shuffle.TieredResultPartitionFactory.createTieredResultPartition(TieredResultPartitionFactory.java:123) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.create(ResultPartitionFactory.java:260) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.partition.ResultPartitionFactory.create(ResultPartitionFactory.java:145) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.io.network.NettyShuffleEnvironment.createResultPartitionWriters(NettyShuffleEnvironment.java:238) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.taskmanager.Task.<init>(Task.java:416) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.taskexecutor.TaskExecutor.submitTask(TaskExecutor.java:858) ~[flink-dist-1.20.3.jar:1.20.3]
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
> at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
> at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
> at java.base/java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
> at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.lambda$handleRpcInvocation$1(PekkoRpcActor.java:318) ~[flink-rpc-akka940ac193-56ac-4139-bf57-df841d42fabd.jar:1.20.3]
> at org.apache.flink.runtime.concurrent.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83) ~[flink-dist-1.20.3.jar:1.20.3]
> at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRpcInvocation(PekkoRpcActor.java:316) ~[flink-rpc-akka940ac193-56ac-4139-bf57-df841d42fabd.jar:1.20.3]
> at org.apache.flink.runtime.rpc.pekko.PekkoRpcActor.handleRpcMessage(PekkoRpcActor.java:229) ~[flink-rpc-akka940ac193-56ac-4139-bf57-df841d42fabd.jar:1.20.3]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)