You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by David Boyd <db...@incadencecorp.com> on 2020/07/02 22:58:42 UTC
%r.ir vs %ir
All:
So with some wailing and knashing of teeth, I was able to build the
IRKernel from source
and install that into my R environment.
So the tutorial uses r.ir - If I run a paragraph with that I get the
below stack trace.
If I run with just %ir it works (for some paragraphs). It also works
for some paragraphs with %spark.ir
Why the difference?
Running 0.9.0 built from source 2-3 days ago.
> org.apache.zeppelin.interpreter.InterpreterException:
> org.apache.zeppelin.interpreter.InterpreterException: Fail to init
> SparkRBackend at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:760)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:668)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:172) at
> org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
> at
> org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:39)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748) Caused by:
> org.apache.zeppelin.interpreter.InterpreterException: Fail to init
> SparkRBackend at
> org.apache.zeppelin.r.IRInterpreter.open(IRInterpreter.java:99) at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
> ... 8 more Caused by: java.lang.reflect.InvocationTargetException at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.apache.zeppelin.r.SparkRBackend.init(SparkRBackend.java:56) at
> org.apache.zeppelin.r.IRInterpreter.open(IRInterpreter.java:97) ... 9
> more Caused by: java.lang.NoClassDefFoundError:
> org/apache/hadoop/fs/FSDataInputStream at
> org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:76)
> at org.apache.spark.SparkConf.<init>(SparkConf.scala:71) at
> org.apache.spark.SparkConf.<init>(SparkConf.scala:58) at
> org.apache.spark.api.r.RBackend.init(RBackend.scala:51) ... 15 more
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.fs.FSDataInputStream at
> java.net.URLClassLoader.findClass(URLClassLoader.java:382) at
> java.lang.ClassLoader.loadClass(ClassLoader.java:418) at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at
> java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 19 more
--
========= mailto:dboyd@incadencecorp.com ============
David W. Boyd
VP, Data Solutions
10432 Balls Ford, Suite 240
Manassas, VA 20109
office: +1-703-552-2862
cell: +1-703-402-7908
============== http://www.incadencecorp.com/ ============
ISO/IEC JTC1 SC42/WG2, editor ISO/IEC 20546, ISO/IEC 20547-1
Chair INCITS TG Big Data
Co-chair NIST Big Data Public Working Group Reference Architecture
First Robotic Mentor - FRC, FTC - www.iliterobotics.org
Board Member- USSTEM Foundation - www.usstem.org
The information contained in this message may be privileged
and/or confidential and protected from disclosure.
If the reader of this message is not the intended recipient
or an employee or agent responsible for delivering this message
to the intended recipient, you are hereby notified that any
dissemination, distribution or copying of this communication
is strictly prohibited. If you have received this communication
in error, please notify the sender immediately by replying to
this message and deleting the material from any computer.
Re: %r.ir vs %ir
Posted by David Boyd <db...@incadencecorp.com>.
Jeff:
mvn clean package -DskipTests -Pspark-2.4 -Phadoop2 -Pscala-2.11
-Dcheckstyle.skip -Drat.skip=true
On 7/2/2020 7:22 PM, Jeff Zhang wrote:
> What's your command of building zeppelin. ?
>
> David Boyd <dboyd@incadencecorp.com <ma...@incadencecorp.com>>
> 于2020年7月3日周五 上午6:59写道：
>
> All:
>
> So with some wailing and knashing of teeth, I was able to build
> the IRKernel from source
> and install that into my R environment.
>
> So the tutorial uses r.ir <http://r.ir> - If I run a paragraph
> with that I get the below stack trace.
>
> If I run with just %ir it works (for some paragraphs). It also
> works for some paragraphs with %spark.ir <http://spark.ir>
>
> Why the difference?
>
> Running 0.9.0 built from source 2-3 days ago.
>
>
>> org.apache.zeppelin.interpreter.InterpreterException:
>> org.apache.zeppelin.interpreter.InterpreterException: Fail to
>> init SparkRBackend at
>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
>> at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:760)
>> at
>> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:668)
>> at org.apache.zeppelin.scheduler.Job.run(Job.java:172) at
>> org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
>> at
>> org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:39)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>> at java.lang.Thread.run(Thread.java:748) Caused by:
>> org.apache.zeppelin.interpreter.InterpreterException: Fail to
>> init SparkRBackend at
>> org.apache.zeppelin.r.IRInterpreter.open(IRInterpreter.java:99)
>> at
>> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
>> ... 8 more Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:498) at
>> org.apache.zeppelin.r.SparkRBackend.init(SparkRBackend.java:56)
>> at
>> org.apache.zeppelin.r.IRInterpreter.open(IRInterpreter.java:97)
>> ... 9 more Caused by: java.lang.NoClassDefFoundError:
>> org/apache/hadoop/fs/FSDataInputStream at
>> org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:76)
>> at org.apache.spark.SparkConf.<init>(SparkConf.scala:71) at
>> org.apache.spark.SparkConf.<init>(SparkConf.scala:58) at
>> org.apache.spark.api.r.RBackend.init(RBackend.scala:51) ... 15
>> more Caused by: java.lang.ClassNotFoundException:
>> org.apache.hadoop.fs.FSDataInputStream at
>> java.net.URLClassLoader.findClass(URLClassLoader.java:382) at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:418) at
>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at
>> java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 19 more
>
> --
> =========mailto:dboyd@incadencecorp.com <ma...@incadencecorp.com> ============
> David W. Boyd
> VP, Data Solutions
> 10432 Balls Ford, Suite 240
> Manassas, VA 20109
> office: +1-703-552-2862
> cell: +1-703-402-7908
> ==============http://www.incadencecorp.com/ <http://www.incadencecorp.com/> ============
> ISO/IEC JTC1 SC42/WG2, editor ISO/IEC 20546, ISO/IEC 20547-1
> Chair INCITS TG Big Data
> Co-chair NIST Big Data Public Working Group Reference Architecture
> First Robotic Mentor - FRC, FTC -www.iliterobotics.org <http://www.iliterobotics.org>
> Board Member- USSTEM Foundation -www.usstem.org <http://www.usstem.org>
>
> The information contained in this message may be privileged
> and/or confidential and protected from disclosure.
> If the reader of this message is not the intended recipient
> or an employee or agent responsible for delivering this message
> to the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication
> is strictly prohibited. If you have received this communication
> in error, please notify the sender immediately by replying to
> this message and deleting the material from any computer.
>
>
>
> --
> Best Regards
>
> Jeff Zhang
--
========= mailto:dboyd@incadencecorp.com ============
David W. Boyd
VP, Data Solutions
10432 Balls Ford, Suite 240
Manassas, VA 20109
office: +1-703-552-2862
cell: +1-703-402-7908
============== http://www.incadencecorp.com/ ============
ISO/IEC JTC1 SC42/WG2, editor ISO/IEC 20546, ISO/IEC 20547-1
Chair INCITS TG Big Data
Co-chair NIST Big Data Public Working Group Reference Architecture
First Robotic Mentor - FRC, FTC - www.iliterobotics.org
Board Member- USSTEM Foundation - www.usstem.org
The information contained in this message may be privileged
and/or confidential and protected from disclosure.
If the reader of this message is not the intended recipient
or an employee or agent responsible for delivering this message
to the intended recipient, you are hereby notified that any
dissemination, distribution or copying of this communication
is strictly prohibited. If you have received this communication
in error, please notify the sender immediately by replying to
this message and deleting the material from any computer.
Re: %r.ir vs %ir
Posted by Jeff Zhang <zj...@gmail.com>.
What's your command of building zeppelin. ?
David Boyd <db...@incadencecorp.com> 于2020年7月3日周五 上午6:59写道：
> All:
>
> So with some wailing and knashing of teeth, I was able to build the
> IRKernel from source
> and install that into my R environment.
>
> So the tutorial uses r.ir - If I run a paragraph with that I get the
> below stack trace.
>
> If I run with just %ir it works (for some paragraphs). It also works for
> some paragraphs with %spark.ir
>
> Why the difference?
>
> Running 0.9.0 built from source 2-3 days ago.
>
>
> org.apache.zeppelin.interpreter.InterpreterException:
> org.apache.zeppelin.interpreter.InterpreterException: Fail to init
> SparkRBackend at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:76)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:760)
> at
> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:668)
> at org.apache.zeppelin.scheduler.Job.run(Job.java:172) at
> org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:130)
> at
> org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:39)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748) Caused by:
> org.apache.zeppelin.interpreter.InterpreterException: Fail to init
> SparkRBackend at
> org.apache.zeppelin.r.IRInterpreter.open(IRInterpreter.java:99) at
> org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:70)
> ... 8 more Caused by: java.lang.reflect.InvocationTargetException at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498) at
> org.apache.zeppelin.r.SparkRBackend.init(SparkRBackend.java:56) at
> org.apache.zeppelin.r.IRInterpreter.open(IRInterpreter.java:97) ... 9 more
> Caused by: java.lang.NoClassDefFoundError:
> org/apache/hadoop/fs/FSDataInputStream at
> org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:76) at
> org.apache.spark.SparkConf.<init>(SparkConf.scala:71) at
> org.apache.spark.SparkConf.<init>(SparkConf.scala:58) at
> org.apache.spark.api.r.RBackend.init(RBackend.scala:51) ... 15 more Caused
> by: java.lang.ClassNotFoundException:
> org.apache.hadoop.fs.FSDataInputStream at
> java.net.URLClassLoader.findClass(URLClassLoader.java:382) at
> java.lang.ClassLoader.loadClass(ClassLoader.java:418) at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at
> java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 19 more
>
>
> --
> ========= mailto:dboyd@incadencecorp.com <db...@incadencecorp.com> ============
> David W. Boyd
> VP, Data Solutions
> 10432 Balls Ford, Suite 240
> Manassas, VA 20109
> office: +1-703-552-2862
> cell: +1-703-402-7908
> ============== http://www.incadencecorp.com/ ============
> ISO/IEC JTC1 SC42/WG2, editor ISO/IEC 20546, ISO/IEC 20547-1
> Chair INCITS TG Big Data
> Co-chair NIST Big Data Public Working Group Reference Architecture
> First Robotic Mentor - FRC, FTC - www.iliterobotics.org
> Board Member- USSTEM Foundation - www.usstem.org
>
> The information contained in this message may be privileged
> and/or confidential and protected from disclosure.
> If the reader of this message is not the intended recipient
> or an employee or agent responsible for delivering this message
> to the intended recipient, you are hereby notified that any
> dissemination, distribution or copying of this communication
> is strictly prohibited. If you have received this communication
> in error, please notify the sender immediately by replying to
> this message and deleting the material from any computer.
>
>
--
Best Regards
Jeff Zhang