Spark Streaming 1.3.0 ERROR LiveListenerBus

[Evo Eftimov <ev...@isecc.com>]

Spark Streaming 1.3.0 on YARN during Job Execution keeps generating the
following error while the application is running:

ERROR LiveListenerBus: Listener EventLoggingListener threw an exception 
java.lang.reflect.InvocationTargetException
etc
etc
Caused by: java.io.IOException: Filesystem closed
   at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:794)


This exception does NOT make the streaming job fail.

Secondly, the streaming job does NOT perform ANY operations with HDFS and is
really a basic streaming job to test a new Spark 1.3.0 deployment on CDH 5.4

The above exception is thrown by the Spark framework itself. I have seen
some posts related to that exception which are about Spark Batch and
confirmed as bug in spark which however is not critical.

And btw this error appears well before any  attempted stop of the spark
streaming context and hence is not related to trying to stop the context 

Does anybody know how to get rid off this in Spark Streaming 1.3.0 on YARN
on CDH 5.4 



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-1-3-0-ERROR-LiveListenerBus-tp23411.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org