You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@zeppelin.apache.org by "Luciano Resende (JIRA)" <ji...@apache.org> on 2016/08/28 18:49:20 UTC

[jira] [Created] (ZEPPELIN-1385) Fail to create SparkSession when connecting to remote Spark

Luciano Resende created ZEPPELIN-1385:
-----------------------------------------

             Summary: Fail to create SparkSession when connecting to remote Spark
                 Key: ZEPPELIN-1385
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1385
             Project: Zeppelin
          Issue Type: Bug
          Components: zeppelin-interpreter
    Affects Versions: 0.6.1
            Reporter: Luciano Resende
            Assignee: Luciano Resende


When connecting to remote Spark cluster, fails to execute job with NPE when trying to create Spark Session because outputDir has not been assigned yet.


DEBUG [2016-08-28 11:42:12,733] ({pool-2-thread-2} Logging.scala[logDebug]:58) - Adding shutdown hook
DEBUG [2016-08-28 11:42:14,735] ({pool-2-thread-2} Interpreter.java[getProperty]:179) - key: master, value: spark://192.168.1.102:7077
 INFO [2016-08-28 11:42:14,735] ({pool-2-thread-2} SparkInterpreter.java[createSparkSession]:299) - ------ Create new SparkContext spark://192.168.1.102:7077 -------
DEBUG [2016-08-28 11:42:14,735] ({pool-2-thread-2} Interpreter.java[getProperty]:179) - key: spark.app.name, value: Zeppelin
DEBUG [2016-08-28 11:42:14,735] ({pool-1-thread-5} Interpreter.java[getProperty]:179) - key: master, value: spark://192.168.1.102:7077
ERROR [2016-08-28 11:42:14,736] ({pool-2-thread-2} Job.java[run]:182) - Job failed
java.lang.NullPointerException
	at org.apache.zeppelin.spark.SparkInterpreter.createSparkSession(SparkInterpreter.java:307)
	at org.apache.zeppelin.spark.SparkInterpreter.getSparkSession(SparkInterpreter.java:218)
	at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:748)
	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
	at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:385)
	at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
	at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)