You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/08/27 10:03:45 UTC
[jira] [Commented] (SPARK-10039) Resetting REPL state does not work
[ https://issues.apache.org/jira/browse/SPARK-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716247#comment-14716247 ]
Sean Owen commented on SPARK-10039:
-----------------------------------
I assume this just affects 2.10 since the 2.11 build uses a much more off-the-shelf Scala shell / REPL rather than a modified fork.
Is the code in question part of what Spark modified from the 2.10 REPL -- can you tell? then indeed maybe this is just a simple bug fix. But if it's from upstream Scala code, then I wonder if this is really the problem and solution.
> Resetting REPL state does not work
> ----------------------------------
>
> Key: SPARK-10039
> URL: https://issues.apache.org/jira/browse/SPARK-10039
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell
> Affects Versions: 1.4.1
> Reporter: Kevin Jung
> Priority: Minor
>
> Spark shell can't find a base directory of class server after running ":reset" command.
> {quote}
> scala> :reset
> scala> 1
> uncaught exception during compilation: java.lang.AssertiON-ERROR
> java.lang.AssertiON-ERROR: assertion failed: Tried to find '$line33' in '/tmp/spark-f47f3917-ac31-4138-bf1a-a8cefd094ac3' but it is not a directory
> ~~~impossible to command anymore including 'exit'~~~
> {quote}
> I figure out reset() method in SparkIMain try to delete virtualDirectory and then create again. But virtualDirectory.create() makes a file, not a directory. Details here.
> {quote}
> drwxrwxr-x. 3 root root 0 2015-08-17 09:09 spark-9cfc6b06-c902-4caf-8712-9ea63f17d017
> (After :reset)
> \-rw-rw-r--. 1 root root 0 2015-08-17 09:09 spark-9cfc6b06-c902-4caf-8712-9ea63f17d017
> {quote}
> "vd.delete; vd.givenPath.createDirectory(true);" will temporarily solve the problem.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org