You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Maciej Bryński (JIRA)" <ji...@apache.org> on 2016/07/28 07:53:21 UTC
[jira] [Comment Edited] (SPARK-15541) SparkContext.stop throws
error
[ https://issues.apache.org/jira/browse/SPARK-15541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397179#comment-15397179 ]
Maciej Bryński edited comment on SPARK-15541 at 7/28/16 7:52 AM:
-----------------------------------------------------------------
Casting ConcurrentHashMap to ConcurrentMap.
(We can't cast to java.util.Map, because we're using putIfAbsent method.)
Fix is only for 1.6 branch.
was (Author: maver1ck):
Casting ConcurrentHashMap to ConcurrentMap.
(We can't cast to java.util.Map, because we're using putIfAbsent method.)
> SparkContext.stop throws error
> ------------------------------
>
> Key: SPARK-15541
> URL: https://issues.apache.org/jira/browse/SPARK-15541
> Project: Spark
> Issue Type: Bug
> Reporter: Miao Wang
>
> When running unit-tests or examples from command line or Intellij, SparkContext throws errors.
> For example:
> ./bin/run-example ml.JavaNaiveBayesExample
> Exception in thread "main" 16/05/25 15:17:55 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
> java.lang.NoSuchMethodError: java.util.concurrent.ConcurrentHashMap.keySet()Ljava/util/concurrent/ConcurrentHashMap$KeySetView;
> at org.apache.spark.rpc.netty.Dispatcher.stop(Dispatcher.scala:176)
> at org.apache.spark.rpc.netty.NettyRpcEnv.cleanup(NettyRpcEnv.scala:291)
> at org.apache.spark.rpc.netty.NettyRpcEnv.shutdown(NettyRpcEnv.scala:269)
> at org.apache.spark.SparkEnv.stop(SparkEnv.scala:91)
> at org.apache.spark.SparkContext$$anonfun$stop$11.apply$mcV$sp(SparkContext.scala:1796)
> at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1219)
> at org.apache.spark.SparkContext.stop(SparkContext.scala:1795)
> at org.apache.spark.sql.SparkSession.stop(SparkSession.scala:577)
> at org.apache.spark.examples.ml.JavaNaiveBayesExample.main(JavaNaiveBayesExample.java:61)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:724)
> at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
> at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> 16/05/25 15:17:55 INFO ShutdownHookManager: Shutdown hook called
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org