You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Frank Dekervel <ke...@gmail.com> on 2016/08/26 13:58:40 UTC
missing scala libraries in flink interpreter ? (binary)
Hello,
I tried the latest zeppelin release (binary with all interpreters), and in
order to make the flink interpreter work in non-local mode, i had to copy
all scala libraries from another interpreter to the flink interpreter.
After trying to connect to an existing flink cluster i got
zeppelin_1 | Exception in thread "pool-1-thread-2"
java.lang.NoClassDefFoundError:
scala/collection/Seq
zeppelin_1 | at java.lang.Class.forName0(Native Method)
zeppelin_1 | at java.lang.Class.forName(Class.java:264)
zeppelin_1 | at org.apache.zeppelin.interpreter.remote.
RemoteInterpreterServer.createInterpreter(RemoteInterpreterServer.java:148)
zeppelin_1 | at org.apache.zeppelin.interpreter.thrift.
RemoteInterpreterService$Processor$createInterpreter.getResult(
RemoteInterpreterService.java:1409)
zeppelin_1 | at org.apache.zeppelin.interpreter.thrift.
RemoteInterpreterService$Processor$createInterpreter.getResult(
RemoteInterpreterService.java:1394)
zeppelin_1 | at org.apache.thrift.ProcessFunction.process(
ProcessFunction.java:39)
zeppelin_1 | at org.apache.thrift.TBaseProcessor.process(
TBaseProcessor.java:39)
zeppelin_1 | at org.apache.thrift.server.TThreadPoolServer$
WorkerProcess.run(TThreadPoolServer.java:285)
zeppelin_1 | at java.util.concurrent.
ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
zeppelin_1 | at java.util.concurrent.
ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
zeppelin_1 | at java.lang.Thread.run(Thread.java:745)
zeppelin_1 | Caused by: java.lang.ClassNotFoundException:
scala.collection.Seq
zeppelin_1 | at java.net.URLClassLoader.
findClass(URLClassLoader.java:381)
zeppelin_1 | at java.lang.ClassLoader.loadClass(ClassLoader.java:
424)
zeppelin_1 | at sun.misc.Launcher$AppClassLoader.loadClass(
Launcher.java:331)
zeppelin_1 | at java.lang.ClassLoader.loadClass(ClassLoader.java:
357)
zeppelin_1 | ... 11 more
to get it working i did
RUN cp /opt/zeppelin/interpreter/ignite/scala*jar /opt/zeppelin/interpreter/
flink/
which would copy:
scala-compiler-2.11.7.jar
scala-library-2.11.7.jar
scala-parser-combinators_2.11-1.0.4.jar
scala-reflect-2.11.7.jar
scala-xml_2.11-1.0.4.jar
According to Trevor Grant (who helped me out on flink-user), that is a
regression of upgrading Zeppelin to spark 2.0/Scala 2.11.
Thanks,
greetings,
Frank
Re: missing scala libraries in flink interpreter ? (binary)
Posted by Trevor Grant <tr...@gmail.com>.
*cough, cough* my best guess is it is a regression due to updating. I
haven't tested anything, but that upgrade did seem to do a lot of damage
and this looks like another casualty. I thought the discussion belonged in
here though based on his solution.
tg
Trevor Grant
Data Scientist
https://github.com/rawkintrevo
http://stackexchange.com/users/3002022/rawkintrevo
http://trevorgrant.org
*"Fortunate is he, who is able to know the causes of things." -Virgil*
On Fri, Aug 26, 2016 at 8:58 AM, Frank Dekervel <ke...@gmail.com> wrote:
> Hello,
>
> I tried the latest zeppelin release (binary with all interpreters), and in
> order to make the flink interpreter work in non-local mode, i had to copy
> all scala libraries from another interpreter to the flink interpreter.
>
> After trying to connect to an existing flink cluster i got
>
> zeppelin_1 | Exception in thread "pool-1-thread-2"
> java.lang.NoClassDefFoundError: scala/collection/Seq
> zeppelin_1 | at java.lang.Class.forName0(Native Method)
> zeppelin_1 | at java.lang.Class.forName(Class.java:264)
> zeppelin_1 | at org.apache.zeppelin.interprete
> r.remote.RemoteInterpreterServer.createInterpreter(RemoteInt
> erpreterServer.java:148)
> zeppelin_1 | at org.apache.zeppelin.interprete
> r.thrift.RemoteInterpreterService$Processor$createInterpreter.getResult(Re
> moteInterpreterService.java:1409)
> zeppelin_1 | at org.apache.zeppelin.interprete
> r.thrift.RemoteInterpreterService$Processor$createInterpreter.getResult(Re
> moteInterpreterService.java:1394)
> zeppelin_1 | at org.apache.thrift.ProcessFunct
> ion.process(ProcessFunction.java:39)
> zeppelin_1 | at org.apache.thrift.TBaseProcess
> or.process(TBaseProcessor.java:39)
> zeppelin_1 | at org.apache.thrift.server.TThre
> adPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
> zeppelin_1 | at java.util.concurrent.ThreadPoo
> lExecutor.runWorker(ThreadPoolExecutor.java:1142)
> zeppelin_1 | at java.util.concurrent.ThreadPoo
> lExecutor$Worker.run(ThreadPoolExecutor.java:617)
> zeppelin_1 | at java.lang.Thread.run(Thread.java:745)
> zeppelin_1 | Caused by: java.lang.ClassNotFoundException:
> scala.collection.Seq
> zeppelin_1 | at java.net.URLClassLoader.findCl
> ass(URLClassLoader.java:381)
> zeppelin_1 | at java.lang.ClassLoader.loadClas
> s(ClassLoader.java:424)
> zeppelin_1 | at sun.misc.Launcher$AppClassLoad
> er.loadClass(Launcher.java:331)
> zeppelin_1 | at java.lang.ClassLoader.loadClas
> s(ClassLoader.java:357)
> zeppelin_1 | ... 11 more
>
> to get it working i did
>
> RUN cp /opt/zeppelin/interpreter/ignite/scala*jar
> /opt/zeppelin/interpreter/flink/
>
> which would copy:
>
> scala-compiler-2.11.7.jar
> scala-library-2.11.7.jar
> scala-parser-combinators_2.11-1.0.4.jar
> scala-reflect-2.11.7.jar
> scala-xml_2.11-1.0.4.jar
>
> According to Trevor Grant (who helped me out on flink-user), that is a
> regression of upgrading Zeppelin to spark 2.0/Scala 2.11.
>
> Thanks,
> greetings,
> Frank
>
>
>
Re: missing scala libraries in flink interpreter ? (binary)
Posted by Luciano Resende <lu...@gmail.com>.
I have created a jira to track the issue
https://issues.apache.org/jira/browse/ZEPPELIN-1379
On Friday, August 26, 2016, Frank Dekervel <ke...@gmail.com> wrote:
> Hello,
>
> I tried the latest zeppelin release (binary with all interpreters), and in
> order to make the flink interpreter work in non-local mode, i had to copy
> all scala libraries from another interpreter to the flink interpreter.
>
> After trying to connect to an existing flink cluster i got
>
> zeppelin_1 | Exception in thread "pool-1-thread-2"
> java.lang.NoClassDefFoundError: scala/collection/Seq
> zeppelin_1 | at java.lang.Class.forName0(Native Method)
> zeppelin_1 | at java.lang.Class.forName(Class.java:264)
> zeppelin_1 | at org.apache.zeppelin.interprete
> r.remote.RemoteInterpreterServer.createInterpreter(RemoteInt
> erpreterServer.java:148)
> zeppelin_1 | at org.apache.zeppelin.interprete
> r.thrift.RemoteInterpreterService$Processor$createInterpreter.getResult(Re
> moteInterpreterService.java:1409)
> zeppelin_1 | at org.apache.zeppelin.interprete
> r.thrift.RemoteInterpreterService$Processor$createInterpreter.getResult(Re
> moteInterpreterService.java:1394)
> zeppelin_1 | at org.apache.thrift.ProcessFunct
> ion.process(ProcessFunction.java:39)
> zeppelin_1 | at org.apache.thrift.TBaseProcess
> or.process(TBaseProcessor.java:39)
> zeppelin_1 | at org.apache.thrift.server.TThre
> adPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
> zeppelin_1 | at java.util.concurrent.ThreadPoo
> lExecutor.runWorker(ThreadPoolExecutor.java:1142)
> zeppelin_1 | at java.util.concurrent.ThreadPoo
> lExecutor$Worker.run(ThreadPoolExecutor.java:617)
> zeppelin_1 | at java.lang.Thread.run(Thread.java:745)
> zeppelin_1 | Caused by: java.lang.ClassNotFoundException:
> scala.collection.Seq
> zeppelin_1 | at java.net.URLClassLoader.findCl
> ass(URLClassLoader.java:381)
> zeppelin_1 | at java.lang.ClassLoader.loadClas
> s(ClassLoader.java:424)
> zeppelin_1 | at sun.misc.Launcher$AppClassLoad
> er.loadClass(Launcher.java:331)
> zeppelin_1 | at java.lang.ClassLoader.loadClas
> s(ClassLoader.java:357)
> zeppelin_1 | ... 11 more
>
> to get it working i did
>
> RUN cp /opt/zeppelin/interpreter/ignite/scala*jar
> /opt/zeppelin/interpreter/flink/
>
> which would copy:
>
> scala-compiler-2.11.7.jar
> scala-library-2.11.7.jar
> scala-parser-combinators_2.11-1.0.4.jar
> scala-reflect-2.11.7.jar
> scala-xml_2.11-1.0.4.jar
>
> According to Trevor Grant (who helped me out on flink-user), that is a
> regression of upgrading Zeppelin to spark 2.0/Scala 2.11.
>
> Thanks,
> greetings,
> Frank
>
>
>
--
Sent from my Mobile device