You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by wxhsdp <wx...@gmail.com> on 2014/05/04 11:40:58 UTC
sbt run with spark.ContextCleaner ERROR
Hi, all
i use sbt to run my spark application, after the app completes, error
occurs:
14/05/04 17:32:28 INFO network.ConnectionManager: Selector thread was
interrupted!
14/05/04 17:32:28 ERROR spark.ContextCleaner: Error in cleaning thread
java.lang.InterruptedException
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
at
org.apache.spark.ContextCleaner.org$apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:116)
at org.apache.spark.ContextCleaner$$anon$3.run(ContextCleaner.scala:64)
has anyone met this before?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: sbt run with spark.ContextCleaner ERROR
Posted by Grega Kešpret <gr...@celtra.com>.
We have the same problem. We call sc.stop() just before the end of the
application on driver and we get
ERROR: nio.AbstractNioSelector: Interrupted while wait for resources to be
released
This only happens when running the application through sbt. Is there a JIRA
for this already?
I'd be happy to help with this, but I would need some initial direction
where to look.
We are using Spark 1.1
AFAIK this didn't happen when we were using Spark 0.9.
[image: Inline image 1]
Grega
--
[image: Inline image 1]*Grega Kešpret*
Senior Software Engineer, Analytics
M: +386.40.831.938 | Skype: gregakespret
celtra.com <http://www.celtra.com/> | @celtramobile
<http://www.twitter.com/celtramobile>
On Thu, May 8, 2014 at 12:13 AM, Nan Zhu <zh...@gmail.com> wrote:
> same problem +1,
>
> though does not change the program result
>
> --
> Nan Zhu
>
> On Tuesday, May 6, 2014 at 11:58 PM, Tathagata Das wrote:
>
> Okay, this needs to be fixed. Thanks for reporting this!
>
>
>
> On Mon, May 5, 2014 at 11:00 PM, wxhsdp <wx...@gmail.com> wrote:
>
> Hi, TD
>
> i tried on v1.0.0-rc3 and still got the error
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304p5421.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
>
>
>
Re: sbt run with spark.ContextCleaner ERROR
Posted by Nan Zhu <zh...@gmail.com>.
same problem +1,
though does not change the program result
--
Nan Zhu
On Tuesday, May 6, 2014 at 11:58 PM, Tathagata Das wrote:
> Okay, this needs to be fixed. Thanks for reporting this!
>
>
>
> On Mon, May 5, 2014 at 11:00 PM, wxhsdp <wxhsdp@gmail.com (mailto:wxhsdp@gmail.com)> wrote:
> > Hi, TD
> >
> > i tried on v1.0.0-rc3 and still got the error
> >
> >
> >
> > --
> > View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304p5421.html
> > Sent from the Apache Spark User List mailing list archive at Nabble.com (http://Nabble.com).
>
Re: sbt run with spark.ContextCleaner ERROR
Posted by Tathagata Das <ta...@gmail.com>.
Okay, this needs to be fixed. Thanks for reporting this!
On Mon, May 5, 2014 at 11:00 PM, wxhsdp <wx...@gmail.com> wrote:
> Hi, TD
>
> i tried on v1.0.0-rc3 and still got the error
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304p5421.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
Re: sbt run with spark.ContextCleaner ERROR
Posted by wxhsdp <wx...@gmail.com>.
Hi, TD
i tried on v1.0.0-rc3 and still got the error
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304p5421.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: sbt run with spark.ContextCleaner ERROR
Posted by Tathagata Das <ta...@gmail.com>.
Well there has been more bug fixes added to RC3 as well. So its best to try
out the current master and let us know whether you still get the scary logs.
TD
On Sun, May 4, 2014 at 3:52 AM, wxhsdp <wx...@gmail.com> wrote:
> Hi, TD
>
> actually, i'am not very clear with my spark version. i check out from
> https://github.com/apache/spark/trunk on Apr 30.
>
> please tell me from where do you get the version Spark 1.0 RC3
>
> i do not call sparkContext.stop. now i add it to the end of my code
>
> here's the log
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/metrics/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/stages/stage/kill,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/static,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/executors/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/executors,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/environment/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/environment,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/storage/rdd/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/storage/rdd,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/storage/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/storage,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/stages/pool/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/stages/pool,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/stages/stage/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/stages/stage,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/stages/json,null}
> 14/05/04 18:48:21 INFO handler.ContextHandler: stopped
> o.e.j.s.ServletContextHandler{/stages,null}
> 14/05/04 18:48:21 INFO ui.SparkUI: Stopped Spark web UI at
> http://ubuntu.local:4040
> 14/05/04 18:48:21 INFO scheduler.DAGScheduler: Stopping DAGScheduler
> 14/05/04 18:48:22 INFO spark.MapOutputTrackerMasterActor:
> MapOutputTrackerActor stopped!
> 14/05/04 18:48:23 INFO network.ConnectionManager: Selector thread was
> interrupted!
> 14/05/04 18:48:23 INFO network.ConnectionManager: ConnectionManager stopped
> 14/05/04 18:48:23 INFO storage.MemoryStore: MemoryStore cleared
> 14/05/04 18:48:23 INFO storage.BlockManager: BlockManager stopped
> 14/05/04 18:48:23 INFO storage.BlockManagerMasterActor: Stopping
> BlockManagerMaster
> 14/05/04 18:48:23 INFO storage.BlockManagerMaster: BlockManagerMaster
> stopped
> 14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator:
> Shutting down remote daemon.
> 14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator:
> Remote daemon shut down; proceeding with flushing remote transports.
> 14/05/04 18:48:23 INFO spark.SparkContext: Successfully stopped
> SparkContext
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #3
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #1
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #2
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #3
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #1
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #2
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #6
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #4
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #5
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #6
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #4
> 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
> resources to be released #5
> 14/05/04 18:48:23 INFO Remoting: Remoting shut down
> 14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator:
> Remoting shut down.
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304p5309.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
Re: sbt run with spark.ContextCleaner ERROR
Posted by wxhsdp <wx...@gmail.com>.
Hi, TD
actually, i'am not very clear with my spark version. i check out from
https://github.com/apache/spark/trunk on Apr 30.
please tell me from where do you get the version Spark 1.0 RC3
i do not call sparkContext.stop. now i add it to the end of my code
here's the log
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/metrics/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/stages/stage/kill,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/static,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/executors/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/executors,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/environment/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/environment,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/storage/rdd/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/storage/rdd,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/storage/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/storage,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/stages/pool/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/stages/pool,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/stages/stage/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/stages/stage,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/stages/json,null}
14/05/04 18:48:21 INFO handler.ContextHandler: stopped
o.e.j.s.ServletContextHandler{/stages,null}
14/05/04 18:48:21 INFO ui.SparkUI: Stopped Spark web UI at
http://ubuntu.local:4040
14/05/04 18:48:21 INFO scheduler.DAGScheduler: Stopping DAGScheduler
14/05/04 18:48:22 INFO spark.MapOutputTrackerMasterActor:
MapOutputTrackerActor stopped!
14/05/04 18:48:23 INFO network.ConnectionManager: Selector thread was
interrupted!
14/05/04 18:48:23 INFO network.ConnectionManager: ConnectionManager stopped
14/05/04 18:48:23 INFO storage.MemoryStore: MemoryStore cleared
14/05/04 18:48:23 INFO storage.BlockManager: BlockManager stopped
14/05/04 18:48:23 INFO storage.BlockManagerMasterActor: Stopping
BlockManagerMaster
14/05/04 18:48:23 INFO storage.BlockManagerMaster: BlockManagerMaster
stopped
14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator:
Shutting down remote daemon.
14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator:
Remote daemon shut down; proceeding with flushing remote transports.
14/05/04 18:48:23 INFO spark.SparkContext: Successfully stopped SparkContext
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #3
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #1
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #2
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #3
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #1
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #2
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #6
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #4
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #5
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #6
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #4
14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for
resources to be released #5
14/05/04 18:48:23 INFO Remoting: Remoting shut down
14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator:
Remoting shut down.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304p5309.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
Re: sbt run with spark.ContextCleaner ERROR
Posted by Tathagata Das <ta...@gmail.com>.
Can you tell which version of Spark you are using? Spark 1.0 RC3, or
something intermediate?
And do you call sparkContext.stop at the end of your application? If so,
does this error occur before or after the stop()?
TD
On Sun, May 4, 2014 at 2:40 AM, wxhsdp <wx...@gmail.com> wrote:
> Hi, all
>
> i use sbt to run my spark application, after the app completes, error
> occurs:
>
> 14/05/04 17:32:28 INFO network.ConnectionManager: Selector thread was
> interrupted!
> 14/05/04 17:32:28 ERROR spark.ContextCleaner: Error in cleaning thread
> java.lang.InterruptedException
> at java.lang.Object.wait(Native Method)
> at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
> at
> org.apache.spark.ContextCleaner.org
> $apache$spark$ContextCleaner$$keepCleaning(ContextCleaner.scala:116)
> at
> org.apache.spark.ContextCleaner$$anon$3.run(ContextCleaner.scala:64)
>
> has anyone met this before?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>