You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "michael procopio (JIRA)" <ji...@apache.org> on 2016/12/29 21:22:58 UTC
[jira] [Created] (SPARK-19030) Dropped event errors being reported
after SparkContext has been stopped
michael procopio created SPARK-19030:
----------------------------------------
Summary: Dropped event errors being reported after SparkContext has been stopped
Key: SPARK-19030
URL: https://issues.apache.org/jira/browse/SPARK-19030
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.0.2
Environment: Debian 8 using spark-submit with MATLAB integration spark code is being code using java.
Reporter: michael procopio
Priority: Minor
After stop has been called on SparkContext, errors are being reported.
6/12/29 15:54:04 ERROR scheduler.LiveListenerBus: SparkListenerBus has already stopped! Dropping event SparkListenerExecutorMetricsUpdate(2,WrappedArray())
The stack in the hearbeat thread is at the point where the error is thrown is:
Daemon Thread [heartbeat-receiver-event-loop-thread] (Suspended (breakpoint at line 124 in LiveListenerBus))
LiveListenerBus.post(SparkListenerEvent) line: 124
DAGScheduler.executorHeartbeatReceived(String, Tuple4<Object,Object,Object,Seq<AccumulableInfo>>[], BlockManagerId) line: 228
YarnScheduler(TaskSchedulerImpl).executorHeartbeatReceived(String, Tuple2<Object,Seq<AccumulatorV2<?,?>>>[], BlockManagerId) line: 402
HeartbeatReceiver$$anonfun$receiveAndReply$1$$anon$2$$anonfun$run$2.apply$mcV$sp() line: 128
Utils$.tryLogNonFatalError(Function0<BoxedUnit>) line: 1290
HeartbeatReceiver$$anonfun$receiveAndReply$1$$anon$2.run() line: 127
Executors$RunnableAdapter<T>.call() line: 511
ScheduledThreadPoolExecutor$ScheduledFutureTask<V>(FutureTask<V>).run() line: 266
ScheduledThreadPoolExecutor$ScheduledFutureTask<V>.access$201(ScheduledThreadPoolExecutor$ScheduledFutureTask) line: 180
ScheduledThreadPoolExecutor$ScheduledFutureTask<V>.run() line: 293
ScheduledThreadPoolExecutor(ThreadPoolExecutor).runWorker(ThreadPoolExecutor$Worker) line: 1142
ThreadPoolExecutor$Worker.run() line: 617
Thread.run() line: 745
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org