You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Patrick Wendell (JIRA)" <ji...@apache.org> on 2014/12/30 23:49:13 UTC

[jira] [Created] (SPARK-5025) Write a guide for creating well-formed packages for Spark

Patrick Wendell created SPARK-5025:
--------------------------------------

             Summary: Write a guide for creating well-formed packages for Spark
                 Key: SPARK-5025
                 URL: https://issues.apache.org/jira/browse/SPARK-5025
             Project: Spark
          Issue Type: Bug
          Components: Documentation
            Reporter: Patrick Wendell
            Assignee: Patrick Wendell


There are an increasing number of OSS projects providing utilities and extensions to Spark. We should write a guide in the Spark docs that explains how to create, package, and publish a third party Spark library. There are a few issues here such as how to list your dependency on Spark, how to deal with your own third party dependencies, etc. We should also cover how to do this for Python libraries.

In general, we should make it easy to build extension points against any of Spark's API's (e.g. for new data sources, streaming receivers, ML algos, etc) and self-publish libraries.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org