You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Jonathan Esterhazy (JIRA)" <ji...@apache.org> on 2016/07/01 17:41:10 UTC
[jira] [Created] (ZEPPELIN-1096) spark interpreter throws
ClassNotFoundExceptions if spark authentication is enabled
Jonathan Esterhazy created ZEPPELIN-1096:
--------------------------------------------
Summary: spark interpreter throws ClassNotFoundExceptions if spark authentication is enabled
Key: ZEPPELIN-1096
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1096
Project: Zeppelin
Issue Type: Bug
Components: Interpreters
Affects Versions: 0.5.6
Environment: aws emr (emr-4.7.1), spark 1.6.1, zeppelin 0.5.6
Reporter: Jonathan Esterhazy
The spark interpreter can't run code defined in a notebook when spark authentication is enabled. Scala code that uses only built-in functions works fine, but executors throw classnotfoundexceptions when they try to run functions defined in the notebook.
For example,
For example, this code works:
{code:scala}
val rdd = sc.textFile("hdfs://my-text-file")
rdd.take(1).foreach(println)
rdd.saveAsTextFile("hdfs:///my-other-text-file")
{code}
but code like this...
{code:scala}
rdd.filter(_.contains("my data"))
{code}
fails with
{noformat}
Caused by: java.lang.ClassNotFoundException: $iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$iwC$$anonfun$1
at org.apache.spark.repl.ExecutorClassLoader.findClass(ExecutorClassLoader.scala:84)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:348)
...
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)