You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "junbiao chen (Jira)" <ji...@apache.org> on 2021/06/24 08:33:00 UTC
[jira] [Updated] (TEZ-4315) There is potential risk of
ConcurrentModificationException when scheduling task for container
[ https://issues.apache.org/jira/browse/TEZ-4315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
junbiao chen updated TEZ-4315:
------------------------------
Description:
When assigning task to container,YarnTaskSchedulerService need to traverse pending cookieContainerRequests(stored in LinkedHashSet) to select one that mathing the container by calling method getMatchingRequestWithoutPriority. In the meantime, YarnTaskSchedulerService will also remove the completed cookieContainerRequest from LinkedHashSet by calling method
removeTaskRequest
.This may cause ConcurrentModificationException,because LinkedHashSet is not thread-safe.
was:When assigning task to container,YarnTaskSchedulerService need to traverse pending cookieContainerRequests(stored in LinkedHashSet) to select one that mathing the container. In the meantime, YarnTaskSchedulerService will also remove the completed cookieContainerRequest from LinkedHashSet.This may cause ConcurrentModificationException,because LinkedHashSet is not thread-safe.
> There is potential risk of ConcurrentModificationException when scheduling task for container
> ---------------------------------------------------------------------------------------------
>
> Key: TEZ-4315
> URL: https://issues.apache.org/jira/browse/TEZ-4315
> Project: Apache Tez
> Issue Type: Improvement
> Affects Versions: 0.9.1, 0.10.0
> Reporter: junbiao chen
> Priority: Major
>
> When assigning task to container,YarnTaskSchedulerService need to traverse pending cookieContainerRequests(stored in LinkedHashSet) to select one that mathing the container by calling method getMatchingRequestWithoutPriority. In the meantime, YarnTaskSchedulerService will also remove the completed cookieContainerRequest from LinkedHashSet by calling method
> removeTaskRequest
> .This may cause ConcurrentModificationException,because LinkedHashSet is not thread-safe.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)