You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Arthur Andres (JIRA)" <ji...@apache.org> on 2014/12/03 12:43:12 UTC
[jira] [Created] (SPARK-4722) StreamingLinearRegression should
return a DStream of weights when calling trainOn
Arthur Andres created SPARK-4722:
------------------------------------
Summary: StreamingLinearRegression should return a DStream of weights when calling trainOn
Key: SPARK-4722
URL: https://issues.apache.org/jira/browse/SPARK-4722
Project: Spark
Issue Type: Improvement
Components: MLlib, Streaming
Reporter: Arthur Andres
Priority: Minor
When training a model with a stream of new data (Spark Streaming + Spark Mlllib), the weights (and the other part of the regression model) update at every iterations.
At the moment the only output we can get is the prediction when calling predictOn (class StreamingLinearRegression)
It would be a nice improvement if trainOn would return a Dstream of weights (and any other underlying model data) so we can access it and see it evolve. At the moment they are only outputted in the log
For example this could then be saved so when reloading the application we can access this information without having to train the model again.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org