You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Stuart Owen (JIRA)" <ji...@apache.org> on 2015/07/31 01:49:05 UTC
[jira] [Comment Edited] (SPARK-9494) 'spark-ec2 launch' fails with
anaconda python 3.4
[ https://issues.apache.org/jira/browse/SPARK-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648513#comment-14648513 ]
Stuart Owen edited comment on SPARK-9494 at 7/30/15 11:48 PM:
--------------------------------------------------------------
Have not observed any other {{spark-ec2}} commands failing with this setup.
was (Author: stuartaxel):
Have not observed any other `spark-ec2` commands failing with this setup.
> 'spark-ec2 launch' fails with anaconda python 3.4
> -------------------------------------------------
>
> Key: SPARK-9494
> URL: https://issues.apache.org/jira/browse/SPARK-9494
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.4.1
> Environment: OSX, Anaconda, Python 3.4
> Reporter: Stuart Owen
> Priority: Minor
>
> Command I used to launch:
> {code:none}
> $SPARK_HOME/ec2/spark-ec2 \
> -k spark \
> -i ~/keys/spark.pem \
> -s $NUM_SLAVES \
> --copy-aws-credentials \
> --region=us-east-1 \
> --instance-type=m3.2xlarge \
> --spot-price=0.1 \
> launch $CLUSTER_NAME
> {code}
> Execution log:
> {code:none}
> /Users/stuart/Applications/anaconda/lib/python3.4/imp.py:32: PendingDeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
> PendingDeprecationWarning)
> Setting up security groups...
> Searching for existing cluster july-event-fix in region us-east-1...
> Spark AMI: ami-35b1885c
> Launching instances...
> Traceback (most recent call last):
> File "/Users/stuart/Applications/spark-1.4.0-bin-hadoop2.6/ec2/spark_ec2.py", line 1455, in <module>
> main()
> File "/Users/stuart/Applications/spark-1.4.0-bin-hadoop2.6/ec2/spark_ec2.py", line 1447, in main
> real_main()
> File "/Users/stuart/Applications/spark-1.4.0-bin-hadoop2.6/ec2/spark_ec2.py", line 1276, in real_main
> (master_nodes, slave_nodes) = launch_cluster(conn, opts, cluster_name)
> File "/Users/stuart/Applications/spark-1.4.0-bin-hadoop2.6/ec2/spark_ec2.py", line 566, in launch_cluster
> name = '/dev/sd' + string.letters[i + 1]
> AttributeError: 'module' object has no attribute 'letters'
> /Users/stuart/Applications/anaconda/lib/python3.4/imp.py:32: PendingDeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses
> PendingDeprecationWarning)
> ERROR: Could not find a master for cluster july-event-fix in region us-east-1.
> sys:1: ResourceWarning: unclosed <ssl.SSLSocket fd=4, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('192.168.1.2', 55678), raddr=('207.171.162.181', 443)>
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org