You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by "Mark Bidewell (JIRA)" <ji...@apache.org> on 2019/04/10 13:25:00 UTC

[jira] [Created] (ZEPPELIN-4116) SQL UDF do not work with Spark New Interpreter

Mark Bidewell created ZEPPELIN-4116:
---------------------------------------

             Summary: SQL UDF do not work with Spark New Interpreter
                 Key: ZEPPELIN-4116
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4116
             Project: Zeppelin
          Issue Type: Bug
          Components: zeppelin-interpreter
    Affects Versions: 0.8.1
         Environment: Zeppelin 0.8.1.  Spark 2.2.2 . RHEL 7.
            Reporter: Mark Bidewell


If I define a scala case class and attempt to use it in a notebook such as the following code snippet:
{code:java}
case class Test(id: String, role: String, resst: String)
val test = Test("1", "Hello", "World")
val rdd1 = sc.parallelize(List(test))

rdd1.first()
{code}
The run will fail with different exceptions - either MethodNotFound or ClassNotFound.  In contrast if zeppelin.spark.useNew is false the code works as expected.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)