You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Jake Maes (JIRA)" <ji...@apache.org> on 2016/05/06 16:46:12 UTC
[jira] [Updated] (SAMZA-946) ConcurrentModificationException in
TaskAssignmentManager when partition count changes.
[ https://issues.apache.org/jira/browse/SAMZA-946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jake Maes updated SAMZA-946:
----------------------------
Description:
We need to make a copy of the keyset before deleting entries.
Exception in thread "main" java.util.ConcurrentModificationException
at java.util.HashMap$HashIterator.nextNode(HashMap.java:1429)
at java.util.HashMap$KeyIterator.next(HashMap.java:1453)
at java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1102)
at org.apache.samza.container.grouper.task.TaskAssignmentManager.deleteTaskContainerMappings(TaskAssignmentManager.java:127)
at org.apache.samza.container.grouper.task.GroupByContainerCount.getPreviousContainers(GroupByContainerCount.java:158)
at org.apache.samza.container.grouper.task.GroupByContainerCount.balance(GroupByContainerCount.java:89)
at org.apache.samza.coordinator.JobCoordinator$.refreshJobModel(JobCoordinator.scala:254)
at org.apache.samza.coordinator.JobCoordinator$.jobModelGenerator$1(JobCoordinator.scala:186)
at org.apache.samza.coordinator.JobCoordinator$.initializeJobModel(JobCoordinator.scala:192)
at org.apache.samza.coordinator.JobCoordinator$.getJobCoordinator(JobCoordinator.scala:119)
at org.apache.samza.coordinator.JobCoordinator$.apply(JobCoordinator.scala:104)
at org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:74)
at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
I have a unit test that reproduces the issue
> ConcurrentModificationException in TaskAssignmentManager when partition count changes.
> --------------------------------------------------------------------------------------
>
> Key: SAMZA-946
> URL: https://issues.apache.org/jira/browse/SAMZA-946
> Project: Samza
> Issue Type: Bug
> Affects Versions: 0.10.1
> Reporter: Jake Maes
> Assignee: Jake Maes
>
> We need to make a copy of the keyset before deleting entries.
> Exception in thread "main" java.util.ConcurrentModificationException
> at java.util.HashMap$HashIterator.nextNode(HashMap.java:1429)
> at java.util.HashMap$KeyIterator.next(HashMap.java:1453)
> at java.util.Collections$UnmodifiableCollection$1.next(Collections.java:1102)
> at org.apache.samza.container.grouper.task.TaskAssignmentManager.deleteTaskContainerMappings(TaskAssignmentManager.java:127)
> at org.apache.samza.container.grouper.task.GroupByContainerCount.getPreviousContainers(GroupByContainerCount.java:158)
> at org.apache.samza.container.grouper.task.GroupByContainerCount.balance(GroupByContainerCount.java:89)
> at org.apache.samza.coordinator.JobCoordinator$.refreshJobModel(JobCoordinator.scala:254)
> at org.apache.samza.coordinator.JobCoordinator$.jobModelGenerator$1(JobCoordinator.scala:186)
> at org.apache.samza.coordinator.JobCoordinator$.initializeJobModel(JobCoordinator.scala:192)
> at org.apache.samza.coordinator.JobCoordinator$.getJobCoordinator(JobCoordinator.scala:119)
> at org.apache.samza.coordinator.JobCoordinator$.apply(JobCoordinator.scala:104)
> at org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:74)
> at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
> I have a unit test that reproduces the issue
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)