[jira] [Created] (SPARK-27121) Resolve Scala compiler failure for Java 9+ in REPL

["Sean Owen (JIRA)" <ji...@apache.org>]

Sean Owen created SPARK-27121:
---------------------------------

             Summary: Resolve Scala compiler failure for Java 9+ in REPL
                 Key: SPARK-27121
                 URL: https://issues.apache.org/jira/browse/SPARK-27121
             Project: Spark
          Issue Type: Sub-task
          Components: Spark Shell
    Affects Versions: 3.0.0
            Reporter: Sean Owen


Currently under Java 11:
{code}
SingletonReplSuite:
[init] error: error while loading Object, Missing dependency 'object scala in compiler mirror', required by /modules/java.base/java/lang/Object.class

Failed to initialize compiler: object scala in compiler mirror not found.
** Note that as of 2.8 scala does not assume use of the java classpath.
** For the old behavior pass -usejavacp to scala, or if using a Settings
** object programmatically, settings.usejavacp.value = true.

Failed to initialize compiler: object scala in compiler mirror not found.
** Note that as of 2.8 scala does not assume use of the java classpath.
** For the old behavior pass -usejavacp to scala, or if using a Settings
** object programmatically, settings.usejavacp.value = true.
org.apache.spark.repl.SingletonReplSuite *** ABORTED ***
  Exception encountered when invoking run on a nested suite - The code passed to eventually never returned normally. Attempted 110 times over 50.062409015 seconds. Last failure message: cond.apply() was false current output: Interpreter encountered errors during initialization!
  . (SingletonReplSuite.scala:92)
ReplSuite:
- propagation of local properties
[init] error: error while loading Object, Missing dependency 'object scala in compiler mirror', required by /modules/java.base/java/lang/Object.class
...
{code}

This is a fairly well-known issue with Scala and Java 9, though workarounds online don't seem to apply to the REPL. So far I do not think Scala promises compiler compatibility with Java 9+, and indeed that's why we compile with Java 8. However the REPL compiles on the fly.

See for example https://github.com/sbt/sbt/issues/2958



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org