回复： Filesystem closed Exception

[Sea <26...@qq.com>]

Hi, Vinodkc‍
Yes, I found another solution, https://github.com/apache/spark/pull/4771/
I will test it later.‍




------------------ 原始邮件 ------------------
发件人: "vinodkc";<vi...@gmail.com>;
发送时间: 2015年3月21日(星期六) 下午4:52
收件人: "dev"<de...@spark.apache.org>; 

主题: Re: Filesystem closed Exception



Hi Sea,

I've raised a  JIRA Issue on this :
https://issues.apache.org/jira/browse/SPARK-6445 . Making a PR  now

On Sat, Mar 21, 2015 at 11:06 AM, Sea [via Apache Spark Developers List] <
ml-node+s1001551n11145h68@n3.nabble.com> wrote:

> Hi, all:
>
>
>
>
> When I exit the console of spark-sql， the following exception
> throwed......
>
>
> My spark version is 1.3.0, hadoop version is 2.2.0
>
>
> Exception in thread "Thread-3" java.io.IOException: Filesystem closed
>         at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:629)
>         at
> org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1677)
>         at
> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1106)
>
>         at
> org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
>
>         at
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
>
>         at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102)
>
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1397)
>         at
> org.apache.spark.scheduler.EventLoggingListener.stop(EventLoggingListener.scala:196)
>
>         at
> org.apache.spark.SparkContext$$anonfun$stop$4.apply(SparkContext.scala:1388)
>
>         at
> org.apache.spark.SparkContext$$anonfun$stop$4.apply(SparkContext.scala:1388)
>
>         at scala.Option.foreach(Option.scala:236)
>         at org.apache.spark.SparkContext.stop(SparkContext.scala:1388)
>         at
> org.apache.spark.sql.hive.thriftserver.SparkSQLEnv$.stop(SparkSQLEnv.scala:66)
>
>         at
> org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver$$anon$1.run(SparkSQLCLIDriver.scala:107)‍
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-developers-list.1001551.n3.nabble.com/Filesystem-closed-Exception-tp11145.html
>  To start a new topic under Apache Spark Developers List, email
> ml-node+s1001551n1h4@n3.nabble.com
> To unsubscribe from Apache Spark Developers List, click here
> <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=dmlub2Qua2MuaW5AZ21haWwuY29tfDF8MTk2Mjg4MTAzOA==>
> .
> NAML
> <http://apache-spark-developers-list.1001551.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>




--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Filesystem-closed-Exception-tp11145p11148.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.