You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by kachau <um...@gmail.com> on 2015/07/10 18:30:13 UTC
SparkR Error in sparkR.init(master=“local”) in RStudio
I have installed the SparkR package from Spark distribution into the R
library. I can call the following command and it seems to work properly:
library(SparkR)
However, when I try to get the Spark context using the following code,
sc <- sparkR.init(master="local")
It fails after some time with the following message:
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
I have set JAVA_HOME, and I have a working RStudio where I can access other
packages like ggplot2. I don't know why it is not working, and I don't even
know where to investigate the issue.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Khandeshi, Ami" <Am...@fmr.com.INVALID>.
Thank you for your help! I was able to resolve it by changing my working directory to local. The default was a map drive.
From: Khandeshi, Ami
Sent: Friday, October 09, 2015 11:23 AM
To: 'Sun, Rui'; Hossein
Cc: akhandeshi; user@spark.apache.org
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
It seems the problem is with creating Usage: RBackend <tempFilePath>
From: Sun, Rui [mailto:rui.sun@intel.com]
Sent: Wednesday, October 07, 2015 10:23 PM
To: Khandeshi, Ami; Hossein
Cc: akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Can you extract the spark-submit command from the console output, and run it on the Shell, and see if there is any error message?
From: Khandeshi, Ami [mailto:Ami.Khandeshi@fmr.com]
Sent: Wednesday, October 7, 2015 9:57 PM
To: Sun, Rui; Hossein
Cc: akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Tried, multiple permutation of setting home… Still same issue
> Sys.setenv(SPARK_HOME="c:\\DevTools\\spark-1.5.1")
> .libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))
> library(SparkR)
Attaching package: ‘SparkR’
The following objects are masked from ‘package:stats’:
filter, na.omit
The following objects are masked from ‘package:base’:
intersect, rbind, sample, subset, summary, table, transform
> sc<-sparkR.init(master = "local")
Launching java with spark-submit command c:\DevTools\spark-1.5.1/bin/spark-submit.cmd sparkr-shell C:\Users\a554719\AppData\Local\Temp\RtmpkXZVBa\backend_port45ac487f2fbd
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
From: Sun, Rui [mailto:rui.sun@intel.com]
Sent: Wednesday, October 07, 2015 2:35 AM
To: Hossein; Khandeshi, Ami
Cc: akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid?
From: Hossein [mailto:falaki@gmail.com]
Sent: Wednesday, October 7, 2015 12:46 AM
To: Khandeshi, Ami
Cc: Sun, Rui; akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Have you built the Spark jars? Can you run the Spark Scala shell?
--Hossein
On Tuesday, October 6, 2015, Khandeshi, Ami <Am...@fmr.com.invalid>> wrote:
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> sc <- sparkR.init(master="local")
Launching java with spark-submit command /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
In addition: Warning message:
running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127
-----Original Message-----
From: Sun, Rui [mailto:rui.sun@intel.com<javascript:;>]
Sent: Tuesday, October 06, 2015 9:39 AM
To: akhandeshi; user@spark.apache.org<javascript:;>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
What you have done is supposed to work. Need more debugging information to find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:ami.khandeshi@gmail.com<javascript:;>]
Sent: Tuesday, October 6, 2015 8:21 PM
To: user@spark.apache.org<javascript:;>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;> For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
--
--Hossein
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Khandeshi, Ami" <Am...@fmr.com.INVALID>.
It seems the problem is with creating Usage: RBackend <tempFilePath>
From: Sun, Rui [mailto:rui.sun@intel.com]
Sent: Wednesday, October 07, 2015 10:23 PM
To: Khandeshi, Ami; Hossein
Cc: akhandeshi; user@spark.apache.org
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Can you extract the spark-submit command from the console output, and run it on the Shell, and see if there is any error message?
From: Khandeshi, Ami [mailto:Ami.Khandeshi@fmr.com]
Sent: Wednesday, October 7, 2015 9:57 PM
To: Sun, Rui; Hossein
Cc: akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Tried, multiple permutation of setting home… Still same issue
> Sys.setenv(SPARK_HOME="c:\\DevTools\\spark-1.5.1")
> .libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))
> library(SparkR)
Attaching package: ‘SparkR’
The following objects are masked from ‘package:stats’:
filter, na.omit
The following objects are masked from ‘package:base’:
intersect, rbind, sample, subset, summary, table, transform
> sc<-sparkR.init(master = "local")
Launching java with spark-submit command c:\DevTools\spark-1.5.1/bin/spark-submit.cmd sparkr-shell C:\Users\a554719\AppData\Local\Temp\RtmpkXZVBa\backend_port45ac487f2fbd
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
From: Sun, Rui [mailto:rui.sun@intel.com]
Sent: Wednesday, October 07, 2015 2:35 AM
To: Hossein; Khandeshi, Ami
Cc: akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid?
From: Hossein [mailto:falaki@gmail.com]
Sent: Wednesday, October 7, 2015 12:46 AM
To: Khandeshi, Ami
Cc: Sun, Rui; akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Have you built the Spark jars? Can you run the Spark Scala shell?
--Hossein
On Tuesday, October 6, 2015, Khandeshi, Ami <Am...@fmr.com.invalid>> wrote:
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> sc <- sparkR.init(master="local")
Launching java with spark-submit command /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
In addition: Warning message:
running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127
-----Original Message-----
From: Sun, Rui [mailto:rui.sun@intel.com<javascript:;>]
Sent: Tuesday, October 06, 2015 9:39 AM
To: akhandeshi; user@spark.apache.org<javascript:;>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
What you have done is supposed to work. Need more debugging information to find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:ami.khandeshi@gmail.com<javascript:;>]
Sent: Tuesday, October 6, 2015 8:21 PM
To: user@spark.apache.org<javascript:;>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;> For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
--
--Hossein
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Sun, Rui" <ru...@intel.com>.
Can you extract the spark-submit command from the console output, and run it on the Shell, and see if there is any error message?
From: Khandeshi, Ami [mailto:Ami.Khandeshi@fmr.com]
Sent: Wednesday, October 7, 2015 9:57 PM
To: Sun, Rui; Hossein
Cc: akhandeshi; user@spark.apache.org
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Tried, multiple permutation of setting home… Still same issue
> Sys.setenv(SPARK_HOME="c:\\DevTools\\spark-1.5.1")
> .libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))
> library(SparkR)
Attaching package: ‘SparkR’
The following objects are masked from ‘package:stats’:
filter, na.omit
The following objects are masked from ‘package:base’:
intersect, rbind, sample, subset, summary, table, transform
> sc<-sparkR.init(master = "local")
Launching java with spark-submit command c:\DevTools\spark-1.5.1/bin/spark-submit.cmd sparkr-shell C:\Users\a554719\AppData\Local\Temp\RtmpkXZVBa\backend_port45ac487f2fbd
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
From: Sun, Rui [mailto:rui.sun@intel.com]
Sent: Wednesday, October 07, 2015 2:35 AM
To: Hossein; Khandeshi, Ami
Cc: akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid?
From: Hossein [mailto:falaki@gmail.com]
Sent: Wednesday, October 7, 2015 12:46 AM
To: Khandeshi, Ami
Cc: Sun, Rui; akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Have you built the Spark jars? Can you run the Spark Scala shell?
--Hossein
On Tuesday, October 6, 2015, Khandeshi, Ami <Am...@fmr.com.invalid>> wrote:
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> sc <- sparkR.init(master="local")
Launching java with spark-submit command /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
In addition: Warning message:
running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127
-----Original Message-----
From: Sun, Rui [mailto:rui.sun@intel.com<javascript:;>]
Sent: Tuesday, October 06, 2015 9:39 AM
To: akhandeshi; user@spark.apache.org<javascript:;>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
What you have done is supposed to work. Need more debugging information to find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:ami.khandeshi@gmail.com<javascript:;>]
Sent: Tuesday, October 6, 2015 8:21 PM
To: user@spark.apache.org<javascript:;>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;> For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
--
--Hossein
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Khandeshi, Ami" <Am...@fmr.com.INVALID>.
Tried, multiple permutation of setting home… Still same issue
> Sys.setenv(SPARK_HOME="c:\\DevTools\\spark-1.5.1")
> .libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))
> library(SparkR)
Attaching package: ‘SparkR’
The following objects are masked from ‘package:stats’:
filter, na.omit
The following objects are masked from ‘package:base’:
intersect, rbind, sample, subset, summary, table, transform
> sc<-sparkR.init(master = "local")
Launching java with spark-submit command c:\DevTools\spark-1.5.1/bin/spark-submit.cmd sparkr-shell C:\Users\a554719\AppData\Local\Temp\RtmpkXZVBa\backend_port45ac487f2fbd
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
From: Sun, Rui [mailto:rui.sun@intel.com]
Sent: Wednesday, October 07, 2015 2:35 AM
To: Hossein; Khandeshi, Ami
Cc: akhandeshi; user@spark.apache.org
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid?
From: Hossein [mailto:falaki@gmail.com]
Sent: Wednesday, October 7, 2015 12:46 AM
To: Khandeshi, Ami
Cc: Sun, Rui; akhandeshi; user@spark.apache.org<ma...@spark.apache.org>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Have you built the Spark jars? Can you run the Spark Scala shell?
--Hossein
On Tuesday, October 6, 2015, Khandeshi, Ami <Am...@fmr.com.invalid>> wrote:
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> sc <- sparkR.init(master="local")
Launching java with spark-submit command /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
In addition: Warning message:
running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127
-----Original Message-----
From: Sun, Rui [mailto:rui.sun@intel.com<javascript:;>]
Sent: Tuesday, October 06, 2015 9:39 AM
To: akhandeshi; user@spark.apache.org<javascript:;>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
What you have done is supposed to work. Need more debugging information to find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:ami.khandeshi@gmail.com<javascript:;>]
Sent: Tuesday, October 6, 2015 8:21 PM
To: user@spark.apache.org<javascript:;>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;> For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
--
--Hossein
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Sun, Rui" <ru...@intel.com>.
Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid?
From: Hossein [mailto:falaki@gmail.com]
Sent: Wednesday, October 7, 2015 12:46 AM
To: Khandeshi, Ami
Cc: Sun, Rui; akhandeshi; user@spark.apache.org
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Have you built the Spark jars? Can you run the Spark Scala shell?
--Hossein
On Tuesday, October 6, 2015, Khandeshi, Ami <Am...@fmr.com.invalid>> wrote:
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> sc <- sparkR.init(master="local")
Launching java with spark-submit command /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
In addition: Warning message:
running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127
-----Original Message-----
From: Sun, Rui [mailto:rui.sun@intel.com<javascript:;>]
Sent: Tuesday, October 06, 2015 9:39 AM
To: akhandeshi; user@spark.apache.org<javascript:;>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
What you have done is supposed to work. Need more debugging information to find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:ami.khandeshi@gmail.com<javascript:;>]
Sent: Tuesday, October 6, 2015 8:21 PM
To: user@spark.apache.org<javascript:;>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;> For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org<javascript:;>
For additional commands, e-mail: user-help@spark.apache.org<javascript:;>
--
--Hossein
Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by Hossein <fa...@gmail.com>.
Have you built the Spark jars? Can you run the Spark Scala shell?
--Hossein
On Tuesday, October 6, 2015, Khandeshi, Ami <Am...@fmr.com.invalid>
wrote:
> > Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> > Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
> >
> > sc <- sparkR.init(master="local")
> Launching java with spark-submit command
> /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell
> C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
> Error in sparkR.init(master = "local") :
> JVM is not ready after 10 seconds
> In addition: Warning message:
> running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd"
> --verbose sparkr-shell
> C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had
> status 127
>
> -----Original Message-----
> From: Sun, Rui [mailto:rui.sun@intel.com <javascript:;>]
> Sent: Tuesday, October 06, 2015 9:39 AM
> To: akhandeshi; user@spark.apache.org <javascript:;>
> Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
>
> What you have done is supposed to work. Need more debugging information
> to find the cause.
>
> Could you add the following lines before calling sparkR.init()?
>
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> Then to see if you can find any hint in the console output
>
> -----Original Message-----
> From: akhandeshi [mailto:ami.khandeshi@gmail.com <javascript:;>]
> Sent: Tuesday, October 6, 2015 8:21 PM
> To: user@spark.apache.org <javascript:;>
> Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
>
> I couldn't get this working...
>
> I have have JAVA_HOME set.
> I have defined SPARK_HOME
> Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
> .libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths()))
> library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
> library(SparkR)
> sc<-sparkR.init(master="local")
>
> I get
> Error in sparkR.init(master = "local") :
> JVM is not ready after 10 seconds
>
> What am I missing??
>
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org <javascript:;>
> For additional commands, e-mail: user-help@spark.apache.org <javascript:;>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org <javascript:;>
> For additional commands, e-mail: user-help@spark.apache.org <javascript:;>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org <javascript:;>
> For additional commands, e-mail: user-help@spark.apache.org <javascript:;>
>
>
--
--Hossein
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Khandeshi, Ami" <Am...@fmr.com.INVALID>.
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> sc <- sparkR.init(master="local")
Launching java with spark-submit command /C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
In addition: Warning message:
running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose sparkr-shell C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had status 127
-----Original Message-----
From: Sun, Rui [mailto:rui.sun@intel.com]
Sent: Tuesday, October 06, 2015 9:39 AM
To: akhandeshi; user@spark.apache.org
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
What you have done is supposed to work. Need more debugging information to find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:ami.khandeshi@gmail.com]
Sent: Tuesday, October 6, 2015 8:21 PM
To: user@spark.apache.org
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional commands, e-mail: user-help@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Sun, Rui" <ru...@intel.com>.
What you have done is supposed to work. Need more debugging information to find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:ami.khandeshi@gmail.com]
Sent: Tuesday, October 6, 2015 8:21 PM
To: user@spark.apache.org
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths())) library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org For additional commands, e-mail: user-help@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by akhandeshi <am...@gmail.com>.
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths()))
library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by ashishdutt <as...@gmail.com>.
Hi,
Try this
> Sys.setenv(SPARK_HOME="C:\\spark-1.4.0") # The path to your spark
> installation
> .libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths()))
> library("SparkR", lib.loc="C:\\spark-1.4.0\\lib") # The path to the lib
> folder in the spark location
> library(SparkR)
> sc=sparkR.init(master="local")
Launching java with spark-submit command C:\spark-1.4.0/bin/spark-submit.cmd
sparkr-shell
C:\Users\Ashish\AppData\Local\Temp\RtmpWqFsOB\backend_portbdc329477c6
>
Cheers,
Ashish
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p23800.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by Felix Cheung <fe...@hotmail.com>.
Is it possible that your user does not have permission to write temp file?
On Tue, Oct 6, 2015 at 10:26 AM -0700, "akhandeshi" <am...@gmail.com> wrote:
It seems it is failing at
path <- tempfile(pattern = "backend_port") I do not see backend_port
directory created...
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24958.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by akhandeshi <am...@gmail.com>.
It seems it is failing at
path <- tempfile(pattern = "backend_port") I do not see backend_port
directory created...
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24958.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by Ashish Dutt <as...@gmail.com>.
Hello Rui Sun,
Thanks for your reply.
On reading the file "readme.md" in the section "Using SparkR from RStudio"
it mentions to set the .libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R",
"lib"), .libPaths()))
Please tell me how I can set this in Windows environment? What I mean is
how to setup .libPaths()? where is it in windows environment
Thanks for your help
Sincerely,
Ashish Dutt
On Mon, Jul 13, 2015 at 3:48 PM, Sun, Rui <ru...@intel.com> wrote:
> Hi, Kachau,
>
> If you are using SparkR with RStudio, have you followed the guidelines in
> the section "Using SparkR from RStudio" in
> https://github.com/apache/spark/tree/master/R ?
>
> ________________________________________
> From: kachau [umesh.kacha@gmail.com]
> Sent: Saturday, July 11, 2015 12:30 AM
> To: user@spark.apache.org
> Subject: SparkR Error in sparkR.init(master=“local”) in RStudio
>
> I have installed the SparkR package from Spark distribution into the R
> library. I can call the following command and it seems to work properly:
> library(SparkR)
>
> However, when I try to get the Spark context using the following code,
>
> sc <- sparkR.init(master="local")
> It fails after some time with the following message:
>
> Error in sparkR.init(master = "local") :
> JVM is not ready after 10 seconds
> I have set JAVA_HOME, and I have a working RStudio where I can access other
> packages like ggplot2. I don't know why it is not working, and I don't even
> know where to investigate the issue.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Posted by "Sun, Rui" <ru...@intel.com>.
Hi, Kachau,
If you are using SparkR with RStudio, have you followed the guidelines in the section "Using SparkR from RStudio" in https://github.com/apache/spark/tree/master/R ?
________________________________________
From: kachau [umesh.kacha@gmail.com]
Sent: Saturday, July 11, 2015 12:30 AM
To: user@spark.apache.org
Subject: SparkR Error in sparkR.init(master=“local”) in RStudio
I have installed the SparkR package from Spark distribution into the R
library. I can call the following command and it seems to work properly:
library(SparkR)
However, when I try to get the Spark context using the following code,
sc <- sparkR.init(master="local")
It fails after some time with the following message:
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
I have set JAVA_HOME, and I have a working RStudio where I can access other
packages like ggplot2. I don't know why it is not working, and I don't even
know where to investigate the issue.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org