[jira] [Created] (ZEPPELIN-1367) Spark 2 support broken

["Chris Chow (JIRA)" <ji...@apache.org>]

Chris Chow created ZEPPELIN-1367:
------------------------------------

             Summary: Spark 2 support broken
                 Key: ZEPPELIN-1367
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1367
             Project: Zeppelin
          Issue Type: Bug
          Components: Interpreters
    Affects Versions: 0.7.0
         Environment: Ubuntu 14.04, Spark-2.0.0 preview
            Reporter: Chris Chow


Current version of the zeppelin spark interpreter tries to call a method on the spark repl called "getAddedJars":

{code:java}
 jars = (String[]) Utils.invokeStaticMethod(
              Utils.findClass("org.apache.spark.repl.Main"), "getAddedJars");
{code}
calling code located here
https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java

But that causes an error on my installation of spark:

{noformat}
ERROR [2016-08-25 01:22:05,043] ({pool-2-thread-2} Utils.java[invokeStaticMethod]:49) - org.apache.spark.repl.Main.getAddedJars()
java.lang.NoSuchMethodException: org.apache.spark.repl.Main.getAddedJars()
{noformat}

Looking Spark commit below (commited March 14), that method appears to be eliminated.
https://github.com/apache/spark/blob/8301fadd8d269da11e72870b7a889596e3337839/repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)