You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/01/06 11:06:39 UTC

[jira] [Resolved] (SPARK-4722) StreamingLinearRegression should return a DStream of weights when calling trainOn

     [ https://issues.apache.org/jira/browse/SPARK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen resolved SPARK-4722.
------------------------------
    Resolution: Won't Fix

> StreamingLinearRegression should return a DStream of weights when calling trainOn
> ---------------------------------------------------------------------------------
>
>                 Key: SPARK-4722
>                 URL: https://issues.apache.org/jira/browse/SPARK-4722
>             Project: Spark
>          Issue Type: Improvement
>          Components: MLlib, Streaming
>            Reporter: Arthur Andres
>            Priority: Minor
>              Labels: mllib, regression, streaming
>
> When training a model with a stream of new data (Spark Streaming + Spark Mlllib),  the weights (and the other part of the regression model) update at every iterations.
> At the moment the only output we can get is the prediction when calling predictOn (class StreamingLinearRegression)
> It would be a nice improvement if trainOn would return a Dstream of weights (and any other underlying model data) so we can access it and see it evolve. At the moment they are only outputted in the log
> For example this could then be saved so when reloading the application we can access this information without having to train the model again.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org