[jira] [Created] (ZEPPELIN-316) ClassNotFoundException on all tries to run something with the Flink interpreter

["Jens Rabe (JIRA)" <ji...@apache.org>]

Jens Rabe created ZEPPELIN-316:
----------------------------------

             Summary: ClassNotFoundException on all tries to run something with the Flink interpreter
                 Key: ZEPPELIN-316
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-316
             Project: Zeppelin
          Issue Type: Bug
          Components: Interpreters
    Affects Versions: 0.6.0
            Reporter: Jens Rabe


I just deployed Flink 0.9.1 on YARN, and ran the provided examples successfully. I then tried to use the Flink interpreter with Zeppelin. I set the host and port accordingly in the settings and tried a basic example:

{code}
%flink
val env = ExecutionEnvironment.getExecutionEnvironment
val input = env.readTextFile("hdfs://my-namenode:8020/user/jens/pg2600.txt")

// tokenize words
val words = input.flatMap { _.split(" ") map { (_, 1) } }

// count by word
val counts = words.groupBy (0)
  .reduce { (w1, w2) => (w1._1, w1._2 + w2._2) }

counts.print()
env.execute("Word count on \"War and Peace\"")
{code}

This gives me:

{code}
env: org.apache.flink.api.scala.ExecutionEnvironment = org.apache.flink.api.scala.ExecutionEnvironment@18ab36c input: org.apache.flink.api.scala.DataSet[String] = org.apache.flink.api.scala.DataSet@1bb0451 words: org.apache.flink.api.scala.DataSet[(String, Int)] = org.apache.flink.api.scala.DataSet@19773d6 counts: org.apache.flink.api.scala.DataSet[(String, Int)] = org.apache.flink.api.scala.DataSet@6050f3 org.apache.flink.runtime.client.JobExecutionException: Job execution failed. at org.apache.flink.runtime.jobmanager.JobManager$$anonfun$receiveWithLogMessages$1.applyOrElse(JobManager.scala:314) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply$mcVL$sp(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:33) at scala.runtime.AbstractPartialFunction$mcVL$sp.apply(AbstractPartialFunction.scala:25) at org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:36) at org.apache.flink.runtime.ActorLogMessages$$anon$1.apply(ActorLogMessages.scala:29) at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:118) at org.apache.flink.runtime.ActorLogMessages$$anon$1.applyOrElse(ActorLogMessages.scala:29) at akka.actor.Actor$class.aroundReceive(Actor.scala:465) at org.apache.flink.runtime.jobmanager.JobManager.aroundReceive(JobManager.scala:92) at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) at akka.actor.ActorCell.invoke(ActorCell.scala:487) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:254) at akka.dispatch.Mailbox.run(Mailbox.scala:221) at akka.dispatch.Mailbox.exec(Mailbox.scala:231) at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) Caused by: java.lang.Exception: Call to registerInputOutput() of invokable failed at org.apache.flink.runtime.taskmanager.Task.run(Task.java:504) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.RuntimeException: The initialization of the DataSource's outputs caused an error: The type serializer factory could not load its parameters from the configuration due to missing classes. at org.apache.flink.runtime.operators.DataSourceTask.registerInputOutput(DataSourceTask.java:89) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:501) ... 1 more Caused by: java.lang.RuntimeException: The type serializer factory could not load its parameters from the configuration due to missing classes. at org.apache.flink.runtime.operators.util.TaskConfig.getTypeSerializerFactory(TaskConfig.java:1087) at org.apache.flink.runtime.operators.util.TaskConfig.getOutputSerializer(TaskConfig.java:543) at org.apache.flink.runtime.operators.RegularPactTask.getOutputCollector(RegularPactTask.java:1267) at org.apache.flink.runtime.operators.RegularPactTask.initOutputs(RegularPactTask.java:1375) at org.apache.flink.runtime.operators.DataSourceTask.initOutputs(DataSourceTask.java:290) at org.apache.flink.runtime.operators.DataSourceTask.registerInputOutput(DataSourceTask.java:86) ... 2 more Caused by: java.lang.ClassNotFoundException: $anon$2$$anon$1 at java.net.URLClassLoader$1.run(URLClassLoader.java:366) at java.net.URLClassLoader$1.run(URLClassLoader.java:355) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:354) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:270) at org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:71) at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1612) at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1517) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370) at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:302) at org.apache.flink.util.InstantiationUtil.readObjectFromConfig(InstantiationUtil.java:264) at org.apache.flink.api.java.typeutils.runtime.RuntimeSerializerFactory.readParametersFromConfig(RuntimeSerializerFactory.java:76) at org.apache.flink.runtime.operators.util.TaskConfig.getTypeSerializerFactory(TaskConfig.java:1085) ... 7 more
{code}

I get this error for everything I try.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)