You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "liyunzhang_intel (JIRA)" <ji...@apache.org> on 2017/05/16 08:28:04 UTC
[jira] [Created] (HIVE-16675) Fix ConcurrentModificationException
in SparkClientImpl#startDriver
liyunzhang_intel created HIVE-16675:
---------------------------------------
Summary: Fix ConcurrentModificationException in SparkClientImpl#startDriver
Key: HIVE-16675
URL: https://issues.apache.org/jira/browse/HIVE-16675
Project: Hive
Issue Type: Bug
Reporter: liyunzhang_intel
Assignee: liyunzhang_intel
the exception is
{noformat}
2017-05-16T00:29:37,480 WARN [Driver] client.SparkClientImpl: Exception while waiting for child process.
3926 java.util.ConcurrentModificationException
3927 at java.util.ArrayList$Itr.checkForComodification(ArrayList.java:901) ~[?:1.8.0_91]
3928 at java.util.ArrayList$Itr.next(ArrayList.java:851) ~[?:1.8.0_91]
3929 at org.apache.hive.spark.client.SparkClientImpl$3.run(SparkClientImpl.java:495) [hive-exec-3.0.0-SNAPSHOT.jar:3.0.0-SNAPSHOT]
3930 at java.lang.Thread.run(Thread.java:745) [?:1.8.0_91]
{noformat}
It seems that {{SparkClientImpl.java#childErrorLog}} is read while it is written. It is better to change {{SparkClientImpl.java#childErrorLog}} from ArrayList to CopyOnWriteArrayList to avoid the exception.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)