You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2015/08/22 22:55:46 UTC

[jira] [Commented] (SPARK-10171) AWS Lambda Executors

    [ https://issues.apache.org/jira/browse/SPARK-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14708174#comment-14708174 ] 

Sean Owen commented on SPARK-10171:
-----------------------------------

I don't think that's a good fit, based on my understanding of lambda. It's spinning up jobs in response to some new data arriving, and that's not the Spark model. You can already run Spark using Amazon EMR directly.

> AWS Lambda Executors
> --------------------
>
>                 Key: SPARK-10171
>                 URL: https://issues.apache.org/jira/browse/SPARK-10171
>             Project: Spark
>          Issue Type: Wish
>            Reporter: Jaka Jancar
>            Priority: Minor
>
> It would be great if Spark supported using AWS Lambda for execution in addition to Standalone, Mesos and YARN, getting rid of the concept of a "cluster" and having a single infinite-sized one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org