Zeppelin with external spark

[ba...@wipro.com]

Hi,

I installed Zeppelin in cluster mode and trying to connect with an external spark(spark 1.3.1 hadoop2.6), I have Edited zeppelin.env.sh file with export MASTER="spark://master_adress:7077"
but while executing am getting error at zeppelin UI :

   org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:222) org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93) org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212) org.apache.zeppelin.scheduler.Job.run(Job.java:170) org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:293) java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) java.util.concurrent.FutureTask.run(FutureTask.java:262) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) java.lang.Thread.run(Thread.java:745)

and zeppelin log file gives :

==> zeppelin-babeena-harmonix.log <==
 INFO [2015-05-06 09:09:31,428] ({pool-1-thread-6} RemoteInterpreter.java[init]:141) - Create remote interpreter org.apache.zeppelin.spark.SparkInterpreter
 INFO [2015-05-06 09:09:31,728] ({pool-1-thread-6} RemoteInterpreter.java[init]:141) - Create remote interpreter org.apache.zeppelin.spark.PySparkInterpreter
 INFO [2015-05-06 09:09:31,752] ({pool-1-thread-6} RemoteInterpreter.java[init]:141) - Create remote interpreter org.apache.zeppelin.spark.SparkSqlInterpreter
 INFO [2015-05-06 09:09:31,756] ({pool-1-thread-6} RemoteInterpreter.java[init]:141) - Create remote interpreter org.apache.zeppelin.spark.DepInterpreter
 INFO [2015-05-06 09:09:31,812] ({pool-1-thread-6} Paragraph.java[jobRun]:211) - RUN : sc.version
 INFO [2015-05-06 09:09:32,565] ({Thread-27} NotebookServer.java[broadcast]:251) - SEND >> NOTE

==> zeppelin-babeena-harmonix.out <==
------ Create new SparkContext spark://harmonix:7077 -------

==> zeppelin-babeena-harmonix.log <==
ERROR [2015-05-06 09:10:33,031] ({pool-1-thread-6} Job.java[run]:183) - Job failed
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.TApplicationException: Internal error processing interpret
        at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:222)
        at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
        at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:212)
        at org.apache.zeppelin.scheduler.Job.run(Job.java:170)
        at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:293)
        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
        at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.TApplicationException: Internal error processing interpret
        at org.apache.thrift.TApplicationException.read(TApplicationException.java:108)
        at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
        at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_interpret(RemoteInterpreterService.java:190)
        at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.interpret(RemoteInterpreterService.java:175)
        at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:205)
        ... 11 more
 INFO [2015-05-06 09:10:33,037] ({Thread-27} NotebookServer.java[afterStatusChange]:571) - Job 20150429-072942_209184517 is finished
 INFO [2015-05-06 09:10:33,037] ({Thread-27} Note.java[persist]:309) - Persist note 2ANU5ZGK7 into /home/babeena/zeppelin-apr-21-cluster-sp-131/notebook/2ANU5ZGK7/note.json
 INFO [2015-05-06 09:10:33,070] ({Thread-27} NotebookServer.java[broadcast]:251) - SEND >> NOTE
 INFO [2015-05-06 09:10:33,090] ({pool-1-thread-6} SchedulerFactory.java[jobFinished]:138) - Job paragraph_1430292582769_820597506 finished by scheduler remoteinterpreter_372711954

==> zeppelin-babeena-harmonix.out <==
------ Create new SparkContext spark://harmonix:7077 -------

==> zeppelin-babeena-harmonix.log <==
ERROR [2015-05-06 09:10:42,660] ({Thread-28} JobProgressPoller.java[run]:57) - Can not get or update progress
org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.TApplicationException: Internal error processing getProgress
        at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getProgress(RemoteInterpreter.java:287)
        at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:110)
        at org.apache.zeppelin.notebook.Paragraph.progress(Paragraph.java:179)
        at org.apache.zeppelin.scheduler.JobProgressPoller.run(JobProgressPoller.java:54)
Caused by: org.apache.thrift.TApplicationException: Internal error processing getProgress
        at org.apache.thrift.TApplicationException.read(TApplicationException.java:108)
        at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
        at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_getProgress(RemoteInterpreterService.java:235)
        at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.getProgress(RemoteInterpreterService.java:221)
        at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getProgress(RemoteInterpreter.java:285)
        ... 3 more

?

The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com