[jira] [Updated] (SPARK-3270) Spark API for Application Extensions

["Hyukjin Kwon (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-3270:
--------------------------------
    Labels: bulk-closed  (was: )

> Spark API for Application Extensions
> ------------------------------------
>
>                 Key: SPARK-3270
>                 URL: https://issues.apache.org/jira/browse/SPARK-3270
>             Project: Spark
>          Issue Type: New Feature
>          Components: Spark Core
>            Reporter: Michal Malohlava
>            Priority: Major
>              Labels: bulk-closed
>
> Any application should be able to enrich spark infrastructure by services which are not available by default.  
> Hence, to support such application extensions (aka "extesions"/"plugins") Spark platform should provide:
>   - an API to register an extension 
>   - an API to register a "service" (meaning provided functionality)
>   - well-defined points in Spark infrastructure which can be enriched/hooked by extension
>   - a way of deploying extension (for example, simply putting the extension on classpath and using Java service interface)
>   - a way to access extension from application
> Overall proposal is available here: https://docs.google.com/document/d/1dHF9zi7GzFbYnbV2PwaOQ2eLPoTeiN9IogUe4PAOtrQ/edit?usp=sharing
> Note: In this context, I do not mean reinventing OSGi (or another plugin platform) but it can serve as a good starting point.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org