[GitHub] [zeppelin] Muhammad-ms commented on issue #3605: [ZEPPELIN-4565] Fixed Spark interpreter to allow ZeppelinContext binding in windows

[GitBox <gi...@apache.org>]

Muhammad-ms commented on issue #3605: [ZEPPELIN-4565] Fixed Spark interpreter to allow ZeppelinContext binding in windows
URL: https://github.com/apache/zeppelin/pull/3605#issuecomment-576317480
 
 
   url.toString includes a "file:/" at the beginning of jar path, which is not included in url.getPath(). We observe that the windows does not support paths with "file:/" prepended to the jar paths, as a result of which, the SparkInterpreter instantiation fails. The getPath() function solves this problem for windows and also works on Linux.
   
   Following is the exception and stack trace when we run Spark interpreter in windows without this change:
   `org.apache.zeppelin.interpreter.InterpreterException: Fail to open SparkInterpreter
   	at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:114)
   	at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
   	at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:657)
   	at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:566)
   	at org.apache.zeppelin.scheduler.Job.run(Job.java:172)
   	at org.apache.zeppelin.scheduler.AbstractScheduler.runJob(AbstractScheduler.java:121)
   	at org.apache.zeppelin.scheduler.FIFOScheduler.lambda$runJobInScheduler$0(FIFOScheduler.java:39)
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   	at java.lang.Thread.run(Thread.java:748)
   Caused by: java.lang.RuntimeException: Fail to bind variable: z
   	at org.apache.zeppelin.spark.SparkScala211Interpreter$$anonfun$bind$1.apply$mcV$sp(SparkScala211Interpreter.scala:110)
   	at org.apache.zeppelin.spark.SparkScala211Interpreter$$anonfun$bind$1.apply(SparkScala211Interpreter.scala:107)
   	at org.apache.zeppelin.spark.SparkScala211Interpreter$$anonfun$bind$1.apply(SparkScala211Interpreter.scala:107)
   	at scala.tools.nsc.interpreter.IMain.beQuietDuring(IMain.scala:221)
   	at org.apache.zeppelin.spark.SparkScala211Interpreter.bind(SparkScala211Interpreter.scala:107)
   	at org.apache.zeppelin.spark.BaseSparkScalaInterpreter.createZeppelinContext(BaseSparkScalaInterpreter.scala:325)
   	at org.apache.zeppelin.spark.SparkScala211Interpreter.open(SparkScala211Interpreter.scala:95)
   	at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:98)
   	... 9 more `

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services