You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "holdenk (JIRA)" <ji...@apache.org> on 2016/09/14 19:29:20 UTC
[jira] [Commented] (SPARK-16424) Add support for Structured
Streaming to the ML Pipeline API
[ https://issues.apache.org/jira/browse/SPARK-16424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15491250#comment-15491250 ]
holdenk commented on SPARK-16424:
---------------------------------
Just an update - we have a really early proof of concept branch showing something like this approach can work. After the Strata talk later this month were planning on collecting any additional feedback and working on getting that proof of concept into a shape where we can make an early draft PR for people that are more interested in reviewing those than looking at design documents.
While I've reached out to [~marmbrus] & [~rams] on e-mail just pinging on the JIRA as well in-case you have a chance to take a look. Also cc [~tdas] who was helpful with answering some of my questions if you have any bandwidth to look at this that would be greatly appreciated.
> Add support for Structured Streaming to the ML Pipeline API
> -----------------------------------------------------------
>
> Key: SPARK-16424
> URL: https://issues.apache.org/jira/browse/SPARK-16424
> Project: Spark
> Issue Type: Improvement
> Components: ML, SQL, Streaming
> Reporter: holdenk
>
> For Spark 2.1 we should consider adding support for machine learning on top of the structured streaming API.
> Early work in progress design outline: https://docs.google.com/document/d/1snh7x7b0dQIlTsJNHLr-IxIFgP43RfRV271YK2qGiFQ/edit?usp=sharing
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org