You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/12/27 08:32:23 UTC
[jira] [Updated] (SPARK-4952) Handle
ConcurrentModificationExceptions in SparkEnv.environmentDetails
[ https://issues.apache.org/jira/browse/SPARK-4952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell updated SPARK-4952:
-----------------------------------
Summary: Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails (was: In some cases, spark on yarn failed to start)
> Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails
> -----------------------------------------------------------------------
>
> Key: SPARK-4952
> URL: https://issues.apache.org/jira/browse/SPARK-4952
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, YARN
> Affects Versions: 1.1.0
> Reporter: Guoqiang Li
>
> the log:
> {noformat}
> Exception in thread "main" 14/12/24 12:00:25 INFO cluster.YarnClientSchedulerBackend: Add WebUI Filter. org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter, Map(PROXY_HOSTS -> tuan200, PROXY_URI_BASES -> http://host:9082/proxy/application_1414231702825_488625), /proxy/application_1414231702825_488625
> java.util.ConcurrentModificationException
> at java.util.Hashtable$Enumerator.next(Hashtable.java:1167)
> at scala.collection.convert.Wrappers$JPropertiesWrapper$$anon$3.next(Wrappers.scala:458)
> at scala.collection.convert.Wrappers$JPropertiesWrapper$$anon$3.next(Wrappers.scala:454)
> at scala.collection.Iterator$class.toStream(Iterator.scala:1143)
> at scala.collection.AbstractIterator.toStream(Iterator.scala:1157)
> at scala.collection.Iterator$$anonfun$toStream$1.apply(Iterator.scala:1143)
> at scala.collection.Iterator$$anonfun$toStream$1.apply(Iterator.scala:1143)
> at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1085)
> at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1077)
> at scala.collection.immutable.Stream$$anonfun$filteredTail$1.apply(Stream.scala:1149)
> at scala.collection.immutable.Stream$$anonfun$filteredTail$1.apply(Stream.scala:1149)
> at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1085)
> at scala.collection.immutable.Stream$Cons.tail(Stream.scala:1077)
> at scala.collection.immutable.Stream.length(Stream.scala:284)
> at scala.collection.SeqLike$class.sorted(SeqLike.scala:608)
> at scala.collection.AbstractSeq.sorted(Seq.scala:40)
> at org.apache.spark.SparkEnv$.environmentDetails(SparkEnv.scala:324)
> at org.apache.spark.SparkContext.postEnvironmentUpdate(SparkContext.scala:1319)
> at org.apache.spark.SparkContext.<init>(SparkContext.scala:344)
> at com.zhe800.toona.als.computation.DealCF$.main(DealCF.scala:497)
> at com.zhe800.toona.als.computation.DealCF.main(DealCF.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:329)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> 14/12/24 12:00:25 INFO ui.JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org