You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/04/18 06:58:59 UTC
[jira] [Commented] (SPARK-6989) Spark 1.3 REPL for Scala 2.11
(2.11.2) fails to start, emitting various arcane compiler errors
[ https://issues.apache.org/jira/browse/SPARK-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14501098#comment-14501098 ]
Sean Owen commented on SPARK-6989:
----------------------------------
You are running on 2.11.6, right? of course, it seems like that should all work, but it doesn't work for you. My point is that the shell you are saying doesn't work is Scala's 2.11.2 shell -- with some light modification.
It's possible that the delta is the problem. I can't entirely make out whether the errors are Spark-specific; they involve Spark classes in some cases but they're assertion errors from Scala libraries.
I don't know if this shell is supposed to work even across maintenance releases as-is, though that would be very nice. It's not an "API" for Scala.
A good test of whether this idea has any merit would be to run with Scala 2.11.2. I'll copy this to JIRA for continuation.
> Spark 1.3 REPL for Scala 2.11 (2.11.2) fails to start, emitting various arcane compiler errors
> ----------------------------------------------------------------------------------------------
>
> Key: SPARK-6989
> URL: https://issues.apache.org/jira/browse/SPARK-6989
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell
> Affects Versions: 1.3.0
> Environment: Java 1.8.0_40 on Ubuntu 14.04.1
> Reporter: Michael Allman
> Attachments: spark_repl_2.11_errors.txt
>
>
> When starting the Spark 1.3 spark-shell compiled for Scala 2.11, I get a random assortment of compiler errors. I will attach a transcript.
> One thing I've noticed is that they seem to be less frequent when I increase the driver heap size to 5 GB or so. By comparison, the Spark 1.1 spark-shell on Scala 2.10 has been rock solid with a 512 MB heap.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org