[jira] [Commented] (SPARK-10157) Add ability to specify s3 bootstrap script to spark-ec2

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-10157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14706957#comment-14706957 ] 

Apache Spark commented on SPARK-10157:
--------------------------------------

User 'mdagost' has created a pull request for this issue:
https://github.com/apache/spark/pull/8359

> Add ability to specify s3 bootstrap script to spark-ec2
> -------------------------------------------------------
>
>                 Key: SPARK-10157
>                 URL: https://issues.apache.org/jira/browse/SPARK-10157
>             Project: Spark
>          Issue Type: Improvement
>          Components: EC2
>            Reporter: Michelangelo D'Agostino
>            Priority: Minor
>              Labels: ec2
>
> One of the nice features of using EMR to start spark clusters is that you can specify bootstrap actions to run on each node. This is useful for installing custom libraries, etc. However, you pay a per-node/per-hour premium for using EMR (https://aws.amazon.com/elasticmapreduce/pricing/).
> This pull request adds the --bootstrap-script flag to the spark-ec2 script. This flag specifies an s3 path to a shell script. The script is downloaded and run on each node during the setup process. The flag can be specified multiple times for multiple bootstrap actions.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org