You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Grzegorz Dubicki (JIRA)" <ji...@apache.org> on 2015/01/17 18:40:34 UTC
[jira] [Updated] (SPARK-5298) Spark not starting on EC2 using
spark-ec2
[ https://issues.apache.org/jira/browse/SPARK-5298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Grzegorz Dubicki updated SPARK-5298:
------------------------------------
Environment: I use Spark 1.2.0 + this PR https://github.com/mesos/spark-ec2/pull/76 from my fork https://github.com/grzegorz-dubicki/spark and v4 Spark EC2 script with the same fix from https://github.com/grzegorz-dubicki/spark-ec2
Affects Version/s: 1.2.0
> Spark not starting on EC2 using spark-ec2
> -----------------------------------------
>
> Key: SPARK-5298
> URL: https://issues.apache.org/jira/browse/SPARK-5298
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.2.0
> Environment: I use Spark 1.2.0 + this PR https://github.com/mesos/spark-ec2/pull/76 from my fork https://github.com/grzegorz-dubicki/spark and v4 Spark EC2 script with the same fix from https://github.com/grzegorz-dubicki/spark-ec2
> Reporter: Grzegorz Dubicki
>
> Spark doesn't start after creating it with:
> {noformat}
> ./spark-ec2 -k * -i * -s 1 --region=eu-west-1 --instance-type=t2.micro --spark-version=1.2.0 launch test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/f15caf9ff6c96ec69fee)
> ..or after stopping the instances on EC2 via AWS Console and starting the cluster with:
> {noformat}
> ./spark-ec2 -k * -i * --region=eu-west-1 start test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/8b87192b3aa4e0ed028c)
> Please note these errors in launch output:
> {noformat}
> ~/spark-ec2
> Initializing spark
> ~ ~/spark-ec2
> ERROR: Unknown Spark version
> Initializing shark
> ~ ~/spark-ec2 ~/spark-ec2
> ERROR: Unknown Shark version
> {noformat}
> ..and then these in start output:
> {noformat}
> ./spark-standalone/setup.sh: line 26: /root/spark/sbin/stop-all.sh: Nie ma takiego pliku ani katalogu
> ./spark-standalone/setup.sh: line 31: /root/spark/sbin/start-master.sh: Nie ma takiego pliku ani katalogu
> ./spark-standalone/setup.sh: line 37: /root/spark/sbin/start-slaves.sh: Nie ma takiego pliku ani katalogu
> {noformat}
> (the error message is "No such file or directory", in Polish)
> It seems to be related with http://mail-archives.us.apache.org/mod_mbox/spark-user/201412.mbox/%3cCAJ5A9B_U=mDCXYftDkbk+sLJzBCdPcb0qQS83u0grOzfgkcEow@mail.gmail.com%3e - I also have almost empty Spark and Shark dirs on the master of test2 cluster:
> {noformat}
> root@ip-172-31-7-179 ~]$ ls spark
> conf work
> root@ip-172-31-7-179 ~]$ ls shark/
> conf
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org