[jira] [Created] (SPARK-5298) Spark not starting on EC2 using spark-ec2

["Grzegorz Dubicki (JIRA)" <ji...@apache.org>]

Grzegorz Dubicki created SPARK-5298:
---------------------------------------

             Summary: Spark not starting on EC2 using spark-ec2
                 Key: SPARK-5298
                 URL: https://issues.apache.org/jira/browse/SPARK-5298
             Project: Spark
          Issue Type: Bug
            Reporter: Grzegorz Dubicki


Spark doesn't start after creating it with:

{noformat}
./spark-ec2 -k * -i * -s 1 --region=eu-west-1 --instance-type=t2.micro --spark-version=1.2.0 launch test2
{noformat}

(Output: https://gist.github.com/grzegorz-dubicki/f15caf9ff6c96ec69fee)

..or after stopping the instances on EC2 via AWS Console and starting the cluster with:

{noformat}
./spark-ec2 -k * -i * --region=eu-west-1 start test2
{noformat}

(Output: https://gist.github.com/grzegorz-dubicki/8b87192b3aa4e0ed028c)

Please note these errors in launch output:

{noformat}
~/spark-ec2
Initializing spark
~ ~/spark-ec2
ERROR: Unknown Spark version
Initializing shark
~ ~/spark-ec2 ~/spark-ec2
ERROR: Unknown Shark version
{noformat}

..and then these in start output:

{noformat}
./spark-standalone/setup.sh: line 26: /root/spark/sbin/stop-all.sh: Nie ma takiego pliku ani katalogu
./spark-standalone/setup.sh: line 31: /root/spark/sbin/start-master.sh: Nie ma takiego pliku ani katalogu
./spark-standalone/setup.sh: line 37: /root/spark/sbin/start-slaves.sh: Nie ma takiego pliku ani katalogu
{noformat}
(the error message is "No such file or directory", in Polish)

It seems to be related with http://mail-archives.us.apache.org/mod_mbox/spark-user/201412.mbox/%3cCAJ5A9B_U=mDCXYftDkbk+sLJzBCdPcb0qQS83u0grOzfgkcEow@mail.gmail.com%3e - I also have almost empty Spark and Shark dirs on the master of test2 cluster:

{noformat}
root@ip-172-31-7-179 ~]$ ls spark
conf  work
root@ip-172-31-7-179 ~]$ ls shark/
conf
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org