[jira] [Updated] (SPARK-4605) Spark Kernel to enable interactive Spark applications

["Chip Senkbeil (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chip Senkbeil updated SPARK-4605:
---------------------------------
    Attachment: Kernel Architecture.pdf

PDF outlining the key values of the kernel and its general architecture including an example of executing code.

> Spark Kernel to enable interactive Spark applications
> -----------------------------------------------------
>
>                 Key: SPARK-4605
>                 URL: https://issues.apache.org/jira/browse/SPARK-4605
>             Project: Spark
>          Issue Type: New Feature
>            Reporter: Chip Senkbeil
>         Attachments: Kernel Architecture.pdf
>
>
> Enables applications to interact with a Spark cluster using Scala in several ways:
> * Defining and running core Spark Tasks
> * Collecting results from a cluster without needing to write to external data store
> ** Ability to stream results using well-defined protocol
> * Arbitrary Scala code definition and execution (without submitting heavy-weight jars)
> Applications can be hosted and managed separate from the Spark cluster using the kernel as a proxy to communicate requests.
> The Spark Kernel implements the server side of the IPython Kernel protocol, the rising “de-facto” protocol for language (Python, Haskell, etc.) execution.
> Inherits a suite of industry adopted clients such as the IPython Notebook.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org