You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Luciano Resende (JIRA)" <ji...@apache.org> on 2016/08/28 18:49:20 UTC
[jira] [Created] (ZEPPELIN-1385) Fail to create SparkSession when
connecting to remote Spark
Luciano Resende created ZEPPELIN-1385:
-----------------------------------------
Summary: Fail to create SparkSession when connecting to remote Spark
Key: ZEPPELIN-1385
URL: https://issues.apache.org/jira/browse/ZEPPELIN-1385
Project: Zeppelin
Issue Type: Bug
Components: zeppelin-interpreter
Affects Versions: 0.6.1
Reporter: Luciano Resende
Assignee: Luciano Resende
When connecting to remote Spark cluster, fails to execute job with NPE when trying to create Spark Session because outputDir has not been assigned yet.
DEBUG [2016-08-28 11:42:12,733] ({pool-2-thread-2} Logging.scala[logDebug]:58) - Adding shutdown hook
DEBUG [2016-08-28 11:42:14,735] ({pool-2-thread-2} Interpreter.java[getProperty]:179) - key: master, value: spark://192.168.1.102:7077
INFO [2016-08-28 11:42:14,735] ({pool-2-thread-2} SparkInterpreter.java[createSparkSession]:299) - ------ Create new SparkContext spark://192.168.1.102:7077 -------
DEBUG [2016-08-28 11:42:14,735] ({pool-2-thread-2} Interpreter.java[getProperty]:179) - key: spark.app.name, value: Zeppelin
DEBUG [2016-08-28 11:42:14,735] ({pool-1-thread-5} Interpreter.java[getProperty]:179) - key: master, value: spark://192.168.1.102:7077
ERROR [2016-08-28 11:42:14,736] ({pool-2-thread-2} Job.java[run]:182) - Job failed
java.lang.NullPointerException
at org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:307)
at org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:218)
at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:748)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:385)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)