You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Nasir Khan <na...@gmail.com> on 2014/12/07 11:30:12 UTC
MLlib(Logistic Regression) + Spark Streaming.
I am new to spark.
Lets say i want to develop a machine learning model. which trained on normal
method in MLlib. I want to use that model with classifier Logistic
regression and predict the streaming data coming from a file or socket.
Streaming data -> Logistic Regression -> binary label prediction.
Is it possible? since there is no streaming logistic regression algo like
streaming linear regression.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/MLlib-Logistic-Regression-Spark-Streaming-tp20564.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: MLlib(Logistic Regression) + Spark Streaming.
Posted by Jeremy Freeman <fr...@gmail.com>.
Along with Xiangrui’s suggestion, we will soon be adding an implantation of Streaming Logistic Regression, which will be similar to the current version of Streaming Linear Regression, and continually update the model as new data arrive (JIRA). Hopefully this will be in v1.3.
— Jeremy
-------------------------
jeremyfreeman.net
@thefreemanlab
On Dec 15, 2014, at 2:50 PM, Xiangrui Meng <me...@gmail.com> wrote:
> If you want to train offline and predict online, you can use the
> current LR implementation to train a model and then apply
> model.predict on the dstream. -Xiangrui
>
> On Sun, Dec 7, 2014 at 6:30 PM, Nasir Khan <na...@gmail.com> wrote:
>> I am new to spark.
>> Lets say i want to develop a machine learning model. which trained on normal
>> method in MLlib. I want to use that model with classifier Logistic
>> regression and predict the streaming data coming from a file or socket.
>>
>>
>> Streaming data -> Logistic Regression -> binary label prediction.
>>
>> Is it possible? since there is no streaming logistic regression algo like
>> streaming linear regression.
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/MLlib-Logistic-Regression-Spark-Streaming-tp20564.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
Re: MLlib(Logistic Regression) + Spark Streaming.
Posted by Xiangrui Meng <me...@gmail.com>.
If you want to train offline and predict online, you can use the
current LR implementation to train a model and then apply
model.predict on the dstream. -Xiangrui
On Sun, Dec 7, 2014 at 6:30 PM, Nasir Khan <na...@gmail.com> wrote:
> I am new to spark.
> Lets say i want to develop a machine learning model. which trained on normal
> method in MLlib. I want to use that model with classifier Logistic
> regression and predict the streaming data coming from a file or socket.
>
>
> Streaming data -> Logistic Regression -> binary label prediction.
>
> Is it possible? since there is no streaming logistic regression algo like
> streaming linear regression.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/MLlib-Logistic-Regression-Spark-Streaming-tp20564.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org