You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shuheng Dai (JIRA)" <ji...@apache.org> on 2019/06/04 07:12:00 UTC

[jira] [Updated] (SPARK-27941) Serverless Spark in the Cloud

     [ https://issues.apache.org/jira/browse/SPARK-27941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shuheng Dai updated SPARK-27941:
--------------------------------
    Description: 
Public cloud providers have started offering serverless container services. For example, AWS offers Fargate [https://aws.amazon.com/fargate/]

This opens up the possibility to run Spark workloads in a serverless manner. 

Pluggable authentication

Pluggable scheduler

Pluggable shuffle storage and retrival

Pluggable driver

  was:
Public cloud providers have started offering serverless container services. For example, AWS offers Fargate [https://aws.amazon.com/fargate/]

This opens up the possibility to run Spark workloads in a serverless manner. 

 


> Serverless Spark in the Cloud
> -----------------------------
>
>                 Key: SPARK-27941
>                 URL: https://issues.apache.org/jira/browse/SPARK-27941
>             Project: Spark
>          Issue Type: New Feature
>          Components: Build, Deploy, Scheduler, Security, Shuffle, Spark Core
>    Affects Versions: 3.0.0
>            Reporter: Shuheng Dai
>            Priority: Major
>
> Public cloud providers have started offering serverless container services. For example, AWS offers Fargate [https://aws.amazon.com/fargate/]
> This opens up the possibility to run Spark workloads in a serverless manner. 
> Pluggable authentication
> Pluggable scheduler
> Pluggable shuffle storage and retrival
> Pluggable driver



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org