You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Peter DeNicola <pe...@statefarm.com> on 2016/08/16 14:11:06 UTC
Possible to use Zeppelin Shell Interpreter to start a spark-submit
job?
I’m trying to run a spark-submit job using a jar in HDFS from Zeppelin, but all I’m getting back is Process exited with an error: 1 (Exit value: 1)
Which I’m not sure what this means. If anyone knows anything about this—or if it is even possible—I could use some help.
Re: Possible to use Zeppelin Shell Interpreter to start a
spark-submit job?
Posted by Jeff Zhang <zj...@gmail.com>.
I tried the latest zeppelin, it can tell me the exact exception when I
didn't use spark-submit correctly. What zeppelin version do you use ?
Maybe you can try the latest version
[image: Inline image 1]
On Wed, Aug 17, 2016 at 2:30 AM, Peter DeNicola <
peter.denicola.fh8p@statefarm.com> wrote:
> The spark shell interpreter logs don’t seem to give me much more info. It
> says it cannot run the job and the exception given is
>
>
>
> org.apache.commons.exec.ExecuteException: Process exited with an error: 1
> (Exit value: 1)
>
> at org.apache.commons.exec.DefaultExecutor.executeInternal(
> DefaultExecutor.java:404)
>
> at org.apache.commons.exec.DefaultExecutor.execute(
> DefaultExecutor.java:166)
>
> at org.apache.commons.exec.DefaultExecutor.execute(
> DefaultExecutor.java:153)
>
> at org.apache.zeppelin.shell.ShellInterpreter.interpret(
> ShellInterpreter.java:74)
>
> at org.apache.zeppelin.interpreter.ClassloaderInterpreter.
> interpret(ClassloaderInterpreter.java:57)
>
> at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(
> LazyOpenInterpreter.java:93)
>
> at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$
> InterpretJob.jobRun(RemoteInterpreterServer.java:300)
>
> at org.apache.zeppelin.scheduler.Job.run(Job.java:169)
>
> at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(
> FIFOScheduler.java:134)
>
> at java.util.concurrent.Executors$RunnableAdapter.
> call(Executors.java:511)
>
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>
> at java.util.concurrent.ScheduledThreadPoolExecutor$
> ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
>
>
> *From: *Jeff Zhang <zj...@gmail.com>
> *Reply-To: *"users@zeppelin.apache.org" <us...@zeppelin.apache.org>
> *Date: *Tuesday, August 16, 2016 at 9:13 AM
> *To: *"users@zeppelin.apache.org" <us...@zeppelin.apache.org>
> *Subject: *Re: Possible to use Zeppelin Shell Interpreter to start a
> spark-submit job?
>
>
>
> Please check the shell interpreter log.
>
>
>
> On Tue, Aug 16, 2016 at 10:11 PM, Peter DeNicola <peter.denicola.fh8p@
> statefarm.com> wrote:
>
> I’m trying to run a spark-submit job using a jar in HDFS from Zeppelin,
> but all I’m getting back is Process exited with an error: 1 (Exit value:
> 1)
>
>
>
> Which I’m not sure what this means. If anyone knows anything about this—or
> if it is even possible—I could use some help.
>
>
>
>
>
> --
>
> Best Regards
>
> Jeff Zhang
>
--
Best Regards
Jeff Zhang
Re: Possible to use Zeppelin Shell Interpreter to start a
spark-submit job?
Posted by Peter DeNicola <pe...@statefarm.com>.
The spark shell interpreter logs don’t seem to give me much more info. It says it cannot run the job and the exception given is
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit value: 1)
at org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:166)
at org.apache.commons.exec.DefaultExecutor.execute(DefaultExecutor.java:153)
at org.apache.zeppelin.shell.ShellInterpreter.interpret(ShellInterpreter.java:74)
at org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:57)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:300)
at org.apache.zeppelin.scheduler.Job.run(Job.java:169)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:134)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
From: Jeff Zhang <zj...@gmail.com>
Reply-To: "users@zeppelin.apache.org" <us...@zeppelin.apache.org>
Date: Tuesday, August 16, 2016 at 9:13 AM
To: "users@zeppelin.apache.org" <us...@zeppelin.apache.org>
Subject: Re: Possible to use Zeppelin Shell Interpreter to start a spark-submit job?
Please check the shell interpreter log.
On Tue, Aug 16, 2016 at 10:11 PM, Peter DeNicola <pe...@statefarm.com>> wrote:
I’m trying to run a spark-submit job using a jar in HDFS from Zeppelin, but all I’m getting back is Process exited with an error: 1 (Exit value: 1)
Which I’m not sure what this means. If anyone knows anything about this—or if it is even possible—I could use some help.
--
Best Regards
Jeff Zhang
Re: Possible to use Zeppelin Shell Interpreter to start a
spark-submit job?
Posted by Jeff Zhang <zj...@gmail.com>.
Please check the shell interpreter log.
On Tue, Aug 16, 2016 at 10:11 PM, Peter DeNicola <
peter.denicola.fh8p@statefarm.com> wrote:
> I’m trying to run a spark-submit job using a jar in HDFS from Zeppelin,
> but all I’m getting back is Process exited with an error: 1 (Exit value:
> 1)
>
>
>
> Which I’m not sure what this means. If anyone knows anything about this—or
> if it is even possible—I could use some help.
>
--
Best Regards
Jeff Zhang