[jira] [Created] (ZEPPELIN-1507) SparkR doesn't work on YARN

["Trevor Grant (JIRA)" <ji...@apache.org>]

Trevor Grant created ZEPPELIN-1507:
--------------------------------------

             Summary: SparkR doesn't work on YARN
                 Key: ZEPPELIN-1507
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1507
             Project: Zeppelin
          Issue Type: Bug
          Components: r-interpreter
            Reporter: Trevor Grant
            Assignee: Trevor Grant
            Priority: Minor
             Fix For: 0.6.2, 0.7.0, 0.6.1, 0.6.0


SparkR fails when running on YARN because "localhost" is hardcoded.

Error:
.zeppelinR = SparkR:::callJStatic("org.apache.zeppelin.spark.ZeppelinR", "getZeppelinR", hashCode)

        at org.apache.zeppelin.spark.ZeppelinR.waitForRScriptInitialized(ZeppelinR.java:295)
        at org.apache.zeppelin.spark.ZeppelinR.request(ZeppelinR.java:235)
        at org.apache.zeppelin.spark.ZeppelinR.eval(ZeppelinR.java:183)
        at org.apache.zeppelin.spark.ZeppelinR.open(ZeppelinR.java:172)
        at org.apache.zeppelin.spark.SparkRInterpreter.open(SparkRInterpreter.java:85)
        at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
        at org.apache.zeppelin.interpreter.LazyOpenInterpreter.getProgress(LazyOpenInterpreter.java:110)
        at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer.getProgress(RemoteInterpreterServer.java:454)
        at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1701)
        at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Processor$getProgress.getResult(RemoteInterpreterService.java:1686)
        at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
        at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)


This is was recently fixed in Spark:
https://github.com/apache/spark/pull/14666/files




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)