You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Siddharth Seth (JIRA)" <ji...@apache.org> on 2013/10/09 00:03:41 UTC
[jira] [Updated] (TEZ-538) ConcurrentModificationException while
writing heartbeat response
[ https://issues.apache.org/jira/browse/TEZ-538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated TEZ-538:
-------------------------------
Description:
{code}
2013-10-08 14:48:32,740 WARN [IPC Server handler 24 on 46424] org.apache.hadoop.ipc.Server: Error serializing call response for call heartbeat({ containerId=container_1380753579830_0763_01_000035, requestId=26, startIndex=8, maxEventsToGet=100, taskAttemptIdattempt_1380753579830_0763_1_02_000008_0, eventCount=1 }), rpc version=2, client version=1, methodsFingerPrint=780108658 from Call#29 Retry#0
java.util.ConcurrentModificationException
at java.util.ArrayList$SubList.checkForComodification(ArrayList.java:1129)
at java.util.ArrayList$SubList.size(ArrayList.java:958)
at java.util.Collections$UnmodifiableCollection.size(Collections.java:1055)
at java.util.Collections$UnmodifiableCollection.size(Collections.java:1055)
at org.apache.tez.runtime.api.impl.TezHeartbeatResponse.write(TezHeartbeatResponse.java:73)
at org.apache.hadoop.io.ObjectWritable.writeObject(ObjectWritable.java:202)
at org.apache.hadoop.io.ObjectWritable.writeObject(ObjectWritable.java:128)
at org.apache.hadoop.io.ObjectWritable.write(ObjectWritable.java:82)
at org.apache.hadoop.ipc.Server.setupResponse(Server.java:2318)
at org.apache.hadoop.ipc.Server.access$2900(Server.java:122)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2094)
{code}
Seems ot cause shuffle to block.
Also, have to check what happens to the heartbeat thread in such cases.
was:
{code}
2013-10-08 14:48:32,740 WARN [IPC Server handler 24 on 46424] org.apache.hadoop.ipc.Server: Error serializing call response for call heartbeat({ containerId=container_1380753579830_0763_01_000035, requestId=26, startIndex=8, maxEventsToGet=100, taskAttemptIdattempt_1380753579830_0763_1_02_000008_0, eventCount=1 }), rpc version=2, client version=1, methodsFingerPrint=780108658 from 172.19.0.43:55106 Call#29 Retry#0
java.util.ConcurrentModificationException
at java.util.ArrayList$SubList.checkForComodification(ArrayList.java:1129)
at java.util.ArrayList$SubList.size(ArrayList.java:958)
at java.util.Collections$UnmodifiableCollection.size(Collections.java:1055)
at java.util.Collections$UnmodifiableCollection.size(Collections.java:1055)
at org.apache.tez.runtime.api.impl.TezHeartbeatResponse.write(TezHeartbeatResponse.java:73)
at org.apache.hadoop.io.ObjectWritable.writeObject(ObjectWritable.java:202)
at org.apache.hadoop.io.ObjectWritable.writeObject(ObjectWritable.java:128)
at org.apache.hadoop.io.ObjectWritable.write(ObjectWritable.java:82)
at org.apache.hadoop.ipc.Server.setupResponse(Server.java:2318)
at org.apache.hadoop.ipc.Server.access$2900(Server.java:122)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2094)
{code}
Seems ot cause shuffle to block.
Also, have to check what happens to the heartbeat thread in such cases.
> ConcurrentModificationException while writing heartbeat response
> ----------------------------------------------------------------
>
> Key: TEZ-538
> URL: https://issues.apache.org/jira/browse/TEZ-538
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Siddharth Seth
>
> {code}
> 2013-10-08 14:48:32,740 WARN [IPC Server handler 24 on 46424] org.apache.hadoop.ipc.Server: Error serializing call response for call heartbeat({ containerId=container_1380753579830_0763_01_000035, requestId=26, startIndex=8, maxEventsToGet=100, taskAttemptIdattempt_1380753579830_0763_1_02_000008_0, eventCount=1 }), rpc version=2, client version=1, methodsFingerPrint=780108658 from Call#29 Retry#0
> java.util.ConcurrentModificationException
> at java.util.ArrayList$SubList.checkForComodification(ArrayList.java:1129)
> at java.util.ArrayList$SubList.size(ArrayList.java:958)
> at java.util.Collections$UnmodifiableCollection.size(Collections.java:1055)
> at java.util.Collections$UnmodifiableCollection.size(Collections.java:1055)
> at org.apache.tez.runtime.api.impl.TezHeartbeatResponse.write(TezHeartbeatResponse.java:73)
> at org.apache.hadoop.io.ObjectWritable.writeObject(ObjectWritable.java:202)
> at org.apache.hadoop.io.ObjectWritable.writeObject(ObjectWritable.java:128)
> at org.apache.hadoop.io.ObjectWritable.write(ObjectWritable.java:82)
> at org.apache.hadoop.ipc.Server.setupResponse(Server.java:2318)
> at org.apache.hadoop.ipc.Server.access$2900(Server.java:122)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2094)
> {code}
> Seems ot cause shuffle to block.
> Also, have to check what happens to the heartbeat thread in such cases.
--
This message was sent by Atlassian JIRA
(v6.1#6144)