You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by VIGNESH S <vi...@gmail.com> on 2013/02/01 07:23:29 UTC
Re: can i run mahout algorithms on mobile device..
Hi ,
Thanks for the reply..
How can we make use of the training data done using Hadoop in mobile phones..
For Example,i can do some sort of serialization and store it on disk
and deserialize in mobile and use that data..
is that possible or how can i use the training data without connecting
to a hadoop cluster in real time..
Thanks and Regards
Vignesh Srinivasan
On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com> wrote:
> The *training* of many Mahout algorithms are on Hadoop, but the output
> classifiers (e.g. a binary text classifier [trained with L1 regularization
> to sparsify] for spam filtering) could certainly fit on a small footprint
> like a mobile phone.
>
>
> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
> <ba...@gmail.com>wrote:
>
>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
>> Also Hadoop is a distributed computing framework, it will run on cluster of
>> machines.
>> So ideally it may NOT be possible to run on a Mobile.
>>
>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vi...@gmail.com>
>> wrote:
>>
>> > I am trying to implement some classification in android mobile device..
>> >
>> > is it possible to use mahout in mobile device..Please kindly help me
>> >
>> > --
>> > Thanks and Regards
>> > Vignesh Srinivasan
>> > 9739135640
>> >
>>
>
>
>
> --
>
> -jake
--
Thanks and Regards
Vignesh Srinivasan
9739135640
Re: can i run mahout algorithms on mobile device..
Posted by Mohit Singh <mo...@gmail.com>.
Yes.
Like I said. That project has just taken off!
On Mon, Feb 4, 2013 at 12:44 AM, VIGNESH S <vi...@gmail.com> wrote:
> Hi,
>
> I don,t think graphchi supports many algorithms..
>
>
> Thanks and Regards
> Vignesh Srinivasan
>
> On Sat, Feb 2, 2013 at 2:21 AM, Mohit Singh <mo...@gmail.com> wrote:
> > You should look into graphchi..a new spinoff from graphlab project. which
> > uses disk for graph computations.
> > http://graphlab.org/graphchi/
> > Though, the aim of this project is to be able to do large scale machine
> > learning on laptop
> >
> http://www.technologyreview.com/news/428497/your-laptop-can-now-analyze-big-data/?nlid=nldly&nld=2012-07-17
> > but for reasonable datasets and computations, i think you can make it run
> > on mobile.
> > Though so far, only collaborative filtering and lda are being
> implemented.
> >
> >
> > On Fri, Feb 1, 2013 at 12:23 PM, Jake Mannix <ja...@gmail.com>
> wrote:
> >
> >> On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com>
> >> wrote:
> >>
> >> > Kind of off topic but why Mahout and not Weka and why on a mobile
> device.
> >> >
> >> > Mahout is built to be scalable for large datasets, not something you'd
> >> > associate with a mobile device.
> >>
> >>
> >> Mahout scalability is about the *training set*. For example, you run a
> >> webmail service, you have tons and tons of spam and not-spam emails.
> You
> >> use Mahout to train a classifier on Hadoop using this training data, at
> the
> >> end of the day, you spit out a sparse classifier model file, which could
> >> reasonably be a *very small* blob, under 100-1000KB.
> >>
> >>
> >> > On any mobile device you're going to run into memory issues very
> quickly
> >> > with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
> >> > allowed (i think).
> >> >
> >> > Personally I wouldn't even attempt such a thing, I'd off load the
> heavy
> >> > lifting to a server and simply have the client mobile device request
> >> > whatever it needed.
> >> >
> >> >
> >> > On 1 Feb 2013, at 14:55, Jake Mannix wrote:
> >> >
> >> > > Hi Vignesh,
> >> > >
> >> > > You've got a lot of steps to go through before you can start
> talking
> >> > > about putting it on your mobile device: you need to get your
> training
> >> > > data, train your classifier offline using Mahout, write code in your
> >> > mobile
> >> > > app which links to and uses the classifier package in Mahout that
> will
> >> > > understand how to use the serialized classifier data file, then make
> >> sure
> >> > > your classifier data file is either bundled with your mobile app, or
> >> else
> >> > > downloads it when it needs it.
> >> > >
> >> > > So first, you need to train a classifier (check out Mahout In
> Action
> >> for
> >> > > more detailed instructions on this), it will result in a serialized
> >> > > classifier model on disk at the end of this process.
> >> > >
> >> > >
> >> > > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <
> vigneshklncit@gmail.com>
> >> > wrote:
> >> > >
> >> > >> Hi ,
> >> > >>
> >> > >> Thanks for the reply..
> >> > >>
> >> > >> How can we make use of the training data done using Hadoop in
> mobile
> >> > >> phones..
> >> > >>
> >> > >> For Example,i can do some sort of serialization and store it on
> disk
> >> > >> and deserialize in mobile and use that data..
> >> > >>
> >> > >> is that possible or how can i use the training data without
> connecting
> >> > >> to a hadoop cluster in real time..
> >> > >>
> >> > >>
> >> > >>
> >> > >> Thanks and Regards
> >> > >> Vignesh Srinivasan
> >> > >>
> >> > >>
> >> > >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <
> jake.mannix@gmail.com>
> >> > >> wrote:
> >> > >>> The *training* of many Mahout algorithms are on Hadoop, but the
> >> output
> >> > >>> classifiers (e.g. a binary text classifier [trained with L1
> >> > >> regularization
> >> > >>> to sparsify] for spam filtering) could certainly fit on a small
> >> > footprint
> >> > >>> like a mobile phone.
> >> > >>>
> >> > >>>
> >> > >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
> >> > >>> <ba...@gmail.com>wrote:
> >> > >>>
> >> > >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
> >> > >>>> Also Hadoop is a distributed computing framework, it will run on
> >> > >> cluster of
> >> > >>>> machines.
> >> > >>>> So ideally it may NOT be possible to run on a Mobile.
> >> > >>>>
> >> > >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <
> vigneshklncit@gmail.com
> >> >
> >> > >>>> wrote:
> >> > >>>>
> >> > >>>>> I am trying to implement some classification in android mobile
> >> > >> device..
> >> > >>>>>
> >> > >>>>> is it possible to use mahout in mobile device..Please kindly
> help
> >> me
> >> > >>>>>
> >> > >>>>> --
> >> > >>>>> Thanks and Regards
> >> > >>>>> Vignesh Srinivasan
> >> > >>>>> 9739135640
> >> > >>>>>
> >> > >>>>
> >> > >>>
> >> > >>>
> >> > >>>
> >> > >>> --
> >> > >>>
> >> > >>> -jake
> >> > >>
> >> > >>
> >> > >>
> >> > >> --
> >> > >> Thanks and Regards
> >> > >> Vignesh Srinivasan
> >> > >> 9739135640
> >> > >>
> >> > >
> >> > >
> >> > >
> >> > > --
> >> > >
> >> > > -jake
> >> >
> >> >
> >>
> >>
> >> --
> >>
> >> -jake
> >>
> >
> >
> >
> > --
> > Mohit
> >
> > "When you want success as badly as you want the air, then you will get
> it.
> > There is no other secret of success."
> > -Socrates
>
>
>
> --
> Thanks and Regards
> Vignesh Srinivasan
> 9739135640
>
--
Mohit
"When you want success as badly as you want the air, then you will get it.
There is no other secret of success."
-Socrates
Re: can i run mahout algorithms on mobile device..
Posted by VIGNESH S <vi...@gmail.com>.
Hi,
I don,t think graphchi supports many algorithms..
Thanks and Regards
Vignesh Srinivasan
On Sat, Feb 2, 2013 at 2:21 AM, Mohit Singh <mo...@gmail.com> wrote:
> You should look into graphchi..a new spinoff from graphlab project. which
> uses disk for graph computations.
> http://graphlab.org/graphchi/
> Though, the aim of this project is to be able to do large scale machine
> learning on laptop
> http://www.technologyreview.com/news/428497/your-laptop-can-now-analyze-big-data/?nlid=nldly&nld=2012-07-17
> but for reasonable datasets and computations, i think you can make it run
> on mobile.
> Though so far, only collaborative filtering and lda are being implemented.
>
>
> On Fri, Feb 1, 2013 at 12:23 PM, Jake Mannix <ja...@gmail.com> wrote:
>
>> On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com>
>> wrote:
>>
>> > Kind of off topic but why Mahout and not Weka and why on a mobile device.
>> >
>> > Mahout is built to be scalable for large datasets, not something you'd
>> > associate with a mobile device.
>>
>>
>> Mahout scalability is about the *training set*. For example, you run a
>> webmail service, you have tons and tons of spam and not-spam emails. You
>> use Mahout to train a classifier on Hadoop using this training data, at the
>> end of the day, you spit out a sparse classifier model file, which could
>> reasonably be a *very small* blob, under 100-1000KB.
>>
>>
>> > On any mobile device you're going to run into memory issues very quickly
>> > with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
>> > allowed (i think).
>> >
>> > Personally I wouldn't even attempt such a thing, I'd off load the heavy
>> > lifting to a server and simply have the client mobile device request
>> > whatever it needed.
>> >
>> >
>> > On 1 Feb 2013, at 14:55, Jake Mannix wrote:
>> >
>> > > Hi Vignesh,
>> > >
>> > > You've got a lot of steps to go through before you can start talking
>> > > about putting it on your mobile device: you need to get your training
>> > > data, train your classifier offline using Mahout, write code in your
>> > mobile
>> > > app which links to and uses the classifier package in Mahout that will
>> > > understand how to use the serialized classifier data file, then make
>> sure
>> > > your classifier data file is either bundled with your mobile app, or
>> else
>> > > downloads it when it needs it.
>> > >
>> > > So first, you need to train a classifier (check out Mahout In Action
>> for
>> > > more detailed instructions on this), it will result in a serialized
>> > > classifier model on disk at the end of this process.
>> > >
>> > >
>> > > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com>
>> > wrote:
>> > >
>> > >> Hi ,
>> > >>
>> > >> Thanks for the reply..
>> > >>
>> > >> How can we make use of the training data done using Hadoop in mobile
>> > >> phones..
>> > >>
>> > >> For Example,i can do some sort of serialization and store it on disk
>> > >> and deserialize in mobile and use that data..
>> > >>
>> > >> is that possible or how can i use the training data without connecting
>> > >> to a hadoop cluster in real time..
>> > >>
>> > >>
>> > >>
>> > >> Thanks and Regards
>> > >> Vignesh Srinivasan
>> > >>
>> > >>
>> > >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
>> > >> wrote:
>> > >>> The *training* of many Mahout algorithms are on Hadoop, but the
>> output
>> > >>> classifiers (e.g. a binary text classifier [trained with L1
>> > >> regularization
>> > >>> to sparsify] for spam filtering) could certainly fit on a small
>> > footprint
>> > >>> like a mobile phone.
>> > >>>
>> > >>>
>> > >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
>> > >>> <ba...@gmail.com>wrote:
>> > >>>
>> > >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
>> > >>>> Also Hadoop is a distributed computing framework, it will run on
>> > >> cluster of
>> > >>>> machines.
>> > >>>> So ideally it may NOT be possible to run on a Mobile.
>> > >>>>
>> > >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vigneshklncit@gmail.com
>> >
>> > >>>> wrote:
>> > >>>>
>> > >>>>> I am trying to implement some classification in android mobile
>> > >> device..
>> > >>>>>
>> > >>>>> is it possible to use mahout in mobile device..Please kindly help
>> me
>> > >>>>>
>> > >>>>> --
>> > >>>>> Thanks and Regards
>> > >>>>> Vignesh Srinivasan
>> > >>>>> 9739135640
>> > >>>>>
>> > >>>>
>> > >>>
>> > >>>
>> > >>>
>> > >>> --
>> > >>>
>> > >>> -jake
>> > >>
>> > >>
>> > >>
>> > >> --
>> > >> Thanks and Regards
>> > >> Vignesh Srinivasan
>> > >> 9739135640
>> > >>
>> > >
>> > >
>> > >
>> > > --
>> > >
>> > > -jake
>> >
>> >
>>
>>
>> --
>>
>> -jake
>>
>
>
>
> --
> Mohit
>
> "When you want success as badly as you want the air, then you will get it.
> There is no other secret of success."
> -Socrates
--
Thanks and Regards
Vignesh Srinivasan
9739135640
Re: can i run mahout algorithms on mobile device..
Posted by Mohit Singh <mo...@gmail.com>.
You should look into graphchi..a new spinoff from graphlab project. which
uses disk for graph computations.
http://graphlab.org/graphchi/
Though, the aim of this project is to be able to do large scale machine
learning on laptop
http://www.technologyreview.com/news/428497/your-laptop-can-now-analyze-big-data/?nlid=nldly&nld=2012-07-17
but for reasonable datasets and computations, i think you can make it run
on mobile.
Though so far, only collaborative filtering and lda are being implemented.
On Fri, Feb 1, 2013 at 12:23 PM, Jake Mannix <ja...@gmail.com> wrote:
> On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com>
> wrote:
>
> > Kind of off topic but why Mahout and not Weka and why on a mobile device.
> >
> > Mahout is built to be scalable for large datasets, not something you'd
> > associate with a mobile device.
>
>
> Mahout scalability is about the *training set*. For example, you run a
> webmail service, you have tons and tons of spam and not-spam emails. You
> use Mahout to train a classifier on Hadoop using this training data, at the
> end of the day, you spit out a sparse classifier model file, which could
> reasonably be a *very small* blob, under 100-1000KB.
>
>
> > On any mobile device you're going to run into memory issues very quickly
> > with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
> > allowed (i think).
> >
> > Personally I wouldn't even attempt such a thing, I'd off load the heavy
> > lifting to a server and simply have the client mobile device request
> > whatever it needed.
> >
> >
> > On 1 Feb 2013, at 14:55, Jake Mannix wrote:
> >
> > > Hi Vignesh,
> > >
> > > You've got a lot of steps to go through before you can start talking
> > > about putting it on your mobile device: you need to get your training
> > > data, train your classifier offline using Mahout, write code in your
> > mobile
> > > app which links to and uses the classifier package in Mahout that will
> > > understand how to use the serialized classifier data file, then make
> sure
> > > your classifier data file is either bundled with your mobile app, or
> else
> > > downloads it when it needs it.
> > >
> > > So first, you need to train a classifier (check out Mahout In Action
> for
> > > more detailed instructions on this), it will result in a serialized
> > > classifier model on disk at the end of this process.
> > >
> > >
> > > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com>
> > wrote:
> > >
> > >> Hi ,
> > >>
> > >> Thanks for the reply..
> > >>
> > >> How can we make use of the training data done using Hadoop in mobile
> > >> phones..
> > >>
> > >> For Example,i can do some sort of serialization and store it on disk
> > >> and deserialize in mobile and use that data..
> > >>
> > >> is that possible or how can i use the training data without connecting
> > >> to a hadoop cluster in real time..
> > >>
> > >>
> > >>
> > >> Thanks and Regards
> > >> Vignesh Srinivasan
> > >>
> > >>
> > >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
> > >> wrote:
> > >>> The *training* of many Mahout algorithms are on Hadoop, but the
> output
> > >>> classifiers (e.g. a binary text classifier [trained with L1
> > >> regularization
> > >>> to sparsify] for spam filtering) could certainly fit on a small
> > footprint
> > >>> like a mobile phone.
> > >>>
> > >>>
> > >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
> > >>> <ba...@gmail.com>wrote:
> > >>>
> > >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
> > >>>> Also Hadoop is a distributed computing framework, it will run on
> > >> cluster of
> > >>>> machines.
> > >>>> So ideally it may NOT be possible to run on a Mobile.
> > >>>>
> > >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vigneshklncit@gmail.com
> >
> > >>>> wrote:
> > >>>>
> > >>>>> I am trying to implement some classification in android mobile
> > >> device..
> > >>>>>
> > >>>>> is it possible to use mahout in mobile device..Please kindly help
> me
> > >>>>>
> > >>>>> --
> > >>>>> Thanks and Regards
> > >>>>> Vignesh Srinivasan
> > >>>>> 9739135640
> > >>>>>
> > >>>>
> > >>>
> > >>>
> > >>>
> > >>> --
> > >>>
> > >>> -jake
> > >>
> > >>
> > >>
> > >> --
> > >> Thanks and Regards
> > >> Vignesh Srinivasan
> > >> 9739135640
> > >>
> > >
> > >
> > >
> > > --
> > >
> > > -jake
> >
> >
>
>
> --
>
> -jake
>
--
Mohit
"When you want success as badly as you want the air, then you will get it.
There is no other secret of success."
-Socrates
Re: can i run mahout algorithms on mobile device..
Posted by VIGNESH S <vi...@gmail.com>.
Thanks Jake..
If i use this model in a mobile device,will i be able to update the
model with new training values..
For Example:
Based on the Model,it is classifying some new mail as spam..But it is
not Spam so User select it as not Spam..
Will I be able to update the training model accordingly? is that possible
Thanks and Regards
Vignesh Srinivasan
On Tue, Feb 5, 2013 at 11:22 AM, Jake Mannix <ja...@gmail.com> wrote:
> On Mon, Feb 4, 2013 at 8:47 PM, VIGNESH S <vi...@gmail.com> wrote:
>
>> I am trying to classify mails
>>
>
> And how much training data do you have? How many labeled example emails
> which are _known_
> to be of one class or another do you expect to have available for training?
>
> If this number is not terribly large, then training with Mahout may be
> non-optimal, and you should
> just go with WEKA, Mallet, LibSVM, etc.
>
> Most classifiers (from any library) will produce a small model file at the
> end of the day which
> could potentially be used on a mobile device.
>
> Alternatively, having your mobile app talk to a remote web service would
> allow you to trade
> local memory for remote method calls (presumably the email hits a webserver
> before it
> gets to the cell phone, doing classification there may be a better way to
> go).
>
>
>>
>> On Tue, Feb 5, 2013 at 12:10 AM, Jake Mannix <ja...@gmail.com>
>> wrote:
>> > On Mon, Feb 4, 2013 at 12:53 AM, VIGNESH S <vi...@gmail.com>
>> wrote:
>> >
>> >> Hi Jake,
>> >>
>> >> Thanks for your comments..
>> >>
>> >> What is understood from your comment is Incase of Training,we can use
>> >> hadoop in clusters to generate the trained model blob file..
>> >>
>> >
>> > Using a classifier has two steps: training the classifier (on data which
>> > has already been pre-labeled), and using the trained classifier on
>> > previously unlabeled items to predict the label which that item should
>> > have.
>> >
>> > Some Mahout algorithms can be trained on a Hadoop cluster, but in general
>> > are intended to be trained using large quantities of input data. The
>> > resultant serialized classifier file may be small, and this is what is
>> used
>> > in the second step, and could conceivably fit on a mobile device.
>> >
>> >
>> >> We can use that trained model blob file in mobile device for
>> >> classification..
>> >>
>> >> is it possible to generate trained model blob file for all algorithms?
>> >>
>> >
>> > Not all algorithms even have simple single model files, no.
>> >
>> > What exactly are you trying to do on a mobile device?
>> >
>> >
>> >>
>> >>
>> >>
>> >>
>> >> On Sat, Feb 2, 2013 at 1:53 AM, Jake Mannix <ja...@gmail.com>
>> wrote:
>> >> > On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com>
>> >> wrote:
>> >> >
>> >> >> Kind of off topic but why Mahout and not Weka and why on a mobile
>> >> device.
>> >> >>
>> >> >> Mahout is built to be scalable for large datasets, not something
>> you'd
>> >> >> associate with a mobile device.
>> >> >
>> >> >
>> >> > Mahout scalability is about the *training set*. For example, you run
>> a
>> >> > webmail service, you have tons and tons of spam and not-spam emails.
>> You
>> >> > use Mahout to train a classifier on Hadoop using this training data,
>> at
>> >> the
>> >> > end of the day, you spit out a sparse classifier model file, which
>> could
>> >> > reasonably be a *very small* blob, under 100-1000KB.
>> >> >
>> >> >
>> >> >> On any mobile device you're going to run into memory issues very
>> quickly
>> >> >> with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
>> >> >> allowed (i think).
>> >> >>
>> >> >> Personally I wouldn't even attempt such a thing, I'd off load the
>> heavy
>> >> >> lifting to a server and simply have the client mobile device request
>> >> >> whatever it needed.
>> >> >>
>> >> >>
>> >> >> On 1 Feb 2013, at 14:55, Jake Mannix wrote:
>> >> >>
>> >> >> > Hi Vignesh,
>> >> >> >
>> >> >> > You've got a lot of steps to go through before you can start
>> talking
>> >> >> > about putting it on your mobile device: you need to get your
>> training
>> >> >> > data, train your classifier offline using Mahout, write code in
>> your
>> >> >> mobile
>> >> >> > app which links to and uses the classifier package in Mahout that
>> will
>> >> >> > understand how to use the serialized classifier data file, then
>> make
>> >> sure
>> >> >> > your classifier data file is either bundled with your mobile app,
>> or
>> >> else
>> >> >> > downloads it when it needs it.
>> >> >> >
>> >> >> > So first, you need to train a classifier (check out Mahout In
>> Action
>> >> for
>> >> >> > more detailed instructions on this), it will result in a serialized
>> >> >> > classifier model on disk at the end of this process.
>> >> >> >
>> >> >> >
>> >> >> > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <
>> vigneshklncit@gmail.com>
>> >> >> wrote:
>> >> >> >
>> >> >> >> Hi ,
>> >> >> >>
>> >> >> >> Thanks for the reply..
>> >> >> >>
>> >> >> >> How can we make use of the training data done using Hadoop in
>> mobile
>> >> >> >> phones..
>> >> >> >>
>> >> >> >> For Example,i can do some sort of serialization and store it on
>> disk
>> >> >> >> and deserialize in mobile and use that data..
>> >> >> >>
>> >> >> >> is that possible or how can i use the training data without
>> >> connecting
>> >> >> >> to a hadoop cluster in real time..
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> Thanks and Regards
>> >> >> >> Vignesh Srinivasan
>> >> >> >>
>> >> >> >>
>> >> >> >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <
>> jake.mannix@gmail.com>
>> >> >> >> wrote:
>> >> >> >>> The *training* of many Mahout algorithms are on Hadoop, but the
>> >> output
>> >> >> >>> classifiers (e.g. a binary text classifier [trained with L1
>> >> >> >> regularization
>> >> >> >>> to sparsify] for spam filtering) could certainly fit on a small
>> >> >> footprint
>> >> >> >>> like a mobile phone.
>> >> >> >>>
>> >> >> >>>
>> >> >> >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
>> >> >> >>> <ba...@gmail.com>wrote:
>> >> >> >>>
>> >> >> >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
>> >> >> >>>> Also Hadoop is a distributed computing framework, it will run on
>> >> >> >> cluster of
>> >> >> >>>> machines.
>> >> >> >>>> So ideally it may NOT be possible to run on a Mobile.
>> >> >> >>>>
>> >> >> >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <
>> >> vigneshklncit@gmail.com>
>> >> >> >>>> wrote:
>> >> >> >>>>
>> >> >> >>>>> I am trying to implement some classification in android mobile
>> >> >> >> device..
>> >> >> >>>>>
>> >> >> >>>>> is it possible to use mahout in mobile device..Please kindly
>> help
>> >> me
>> >> >> >>>>>
>> >> >> >>>>> --
>> >> >> >>>>> Thanks and Regards
>> >> >> >>>>> Vignesh Srinivasan
>> >> >> >>>>> 9739135640
>> >> >> >>>>>
>> >> >> >>>>
>> >> >> >>>
>> >> >> >>>
>> >> >> >>>
>> >> >> >>> --
>> >> >> >>>
>> >> >> >>> -jake
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> >> >> >> --
>> >> >> >> Thanks and Regards
>> >> >> >> Vignesh Srinivasan
>> >> >> >> 9739135640
>> >> >> >>
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > --
>> >> >> >
>> >> >> > -jake
>> >> >>
>> >> >>
>> >> >
>> >> >
>> >> > --
>> >> >
>> >> > -jake
>> >>
>> >>
>> >>
>> >> --
>> >> Thanks and Regards
>> >> Vignesh Srinivasan
>> >> 9739135640
>> >>
>> >
>> >
>> >
>> > --
>> >
>> > -jake
>>
>>
>>
>> --
>> Thanks and Regards
>> Vignesh Srinivasan
>> 9739135640
>>
>
>
>
> --
>
> -jake
--
Thanks and Regards
Vignesh Srinivasan
9739135640
Re: can i run mahout algorithms on mobile device..
Posted by Jake Mannix <ja...@gmail.com>.
On Mon, Feb 4, 2013 at 8:47 PM, VIGNESH S <vi...@gmail.com> wrote:
> I am trying to classify mails
>
And how much training data do you have? How many labeled example emails
which are _known_
to be of one class or another do you expect to have available for training?
If this number is not terribly large, then training with Mahout may be
non-optimal, and you should
just go with WEKA, Mallet, LibSVM, etc.
Most classifiers (from any library) will produce a small model file at the
end of the day which
could potentially be used on a mobile device.
Alternatively, having your mobile app talk to a remote web service would
allow you to trade
local memory for remote method calls (presumably the email hits a webserver
before it
gets to the cell phone, doing classification there may be a better way to
go).
>
> On Tue, Feb 5, 2013 at 12:10 AM, Jake Mannix <ja...@gmail.com>
> wrote:
> > On Mon, Feb 4, 2013 at 12:53 AM, VIGNESH S <vi...@gmail.com>
> wrote:
> >
> >> Hi Jake,
> >>
> >> Thanks for your comments..
> >>
> >> What is understood from your comment is Incase of Training,we can use
> >> hadoop in clusters to generate the trained model blob file..
> >>
> >
> > Using a classifier has two steps: training the classifier (on data which
> > has already been pre-labeled), and using the trained classifier on
> > previously unlabeled items to predict the label which that item should
> > have.
> >
> > Some Mahout algorithms can be trained on a Hadoop cluster, but in general
> > are intended to be trained using large quantities of input data. The
> > resultant serialized classifier file may be small, and this is what is
> used
> > in the second step, and could conceivably fit on a mobile device.
> >
> >
> >> We can use that trained model blob file in mobile device for
> >> classification..
> >>
> >> is it possible to generate trained model blob file for all algorithms?
> >>
> >
> > Not all algorithms even have simple single model files, no.
> >
> > What exactly are you trying to do on a mobile device?
> >
> >
> >>
> >>
> >>
> >>
> >> On Sat, Feb 2, 2013 at 1:53 AM, Jake Mannix <ja...@gmail.com>
> wrote:
> >> > On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com>
> >> wrote:
> >> >
> >> >> Kind of off topic but why Mahout and not Weka and why on a mobile
> >> device.
> >> >>
> >> >> Mahout is built to be scalable for large datasets, not something
> you'd
> >> >> associate with a mobile device.
> >> >
> >> >
> >> > Mahout scalability is about the *training set*. For example, you run
> a
> >> > webmail service, you have tons and tons of spam and not-spam emails.
> You
> >> > use Mahout to train a classifier on Hadoop using this training data,
> at
> >> the
> >> > end of the day, you spit out a sparse classifier model file, which
> could
> >> > reasonably be a *very small* blob, under 100-1000KB.
> >> >
> >> >
> >> >> On any mobile device you're going to run into memory issues very
> quickly
> >> >> with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
> >> >> allowed (i think).
> >> >>
> >> >> Personally I wouldn't even attempt such a thing, I'd off load the
> heavy
> >> >> lifting to a server and simply have the client mobile device request
> >> >> whatever it needed.
> >> >>
> >> >>
> >> >> On 1 Feb 2013, at 14:55, Jake Mannix wrote:
> >> >>
> >> >> > Hi Vignesh,
> >> >> >
> >> >> > You've got a lot of steps to go through before you can start
> talking
> >> >> > about putting it on your mobile device: you need to get your
> training
> >> >> > data, train your classifier offline using Mahout, write code in
> your
> >> >> mobile
> >> >> > app which links to and uses the classifier package in Mahout that
> will
> >> >> > understand how to use the serialized classifier data file, then
> make
> >> sure
> >> >> > your classifier data file is either bundled with your mobile app,
> or
> >> else
> >> >> > downloads it when it needs it.
> >> >> >
> >> >> > So first, you need to train a classifier (check out Mahout In
> Action
> >> for
> >> >> > more detailed instructions on this), it will result in a serialized
> >> >> > classifier model on disk at the end of this process.
> >> >> >
> >> >> >
> >> >> > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <
> vigneshklncit@gmail.com>
> >> >> wrote:
> >> >> >
> >> >> >> Hi ,
> >> >> >>
> >> >> >> Thanks for the reply..
> >> >> >>
> >> >> >> How can we make use of the training data done using Hadoop in
> mobile
> >> >> >> phones..
> >> >> >>
> >> >> >> For Example,i can do some sort of serialization and store it on
> disk
> >> >> >> and deserialize in mobile and use that data..
> >> >> >>
> >> >> >> is that possible or how can i use the training data without
> >> connecting
> >> >> >> to a hadoop cluster in real time..
> >> >> >>
> >> >> >>
> >> >> >>
> >> >> >> Thanks and Regards
> >> >> >> Vignesh Srinivasan
> >> >> >>
> >> >> >>
> >> >> >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <
> jake.mannix@gmail.com>
> >> >> >> wrote:
> >> >> >>> The *training* of many Mahout algorithms are on Hadoop, but the
> >> output
> >> >> >>> classifiers (e.g. a binary text classifier [trained with L1
> >> >> >> regularization
> >> >> >>> to sparsify] for spam filtering) could certainly fit on a small
> >> >> footprint
> >> >> >>> like a mobile phone.
> >> >> >>>
> >> >> >>>
> >> >> >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
> >> >> >>> <ba...@gmail.com>wrote:
> >> >> >>>
> >> >> >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
> >> >> >>>> Also Hadoop is a distributed computing framework, it will run on
> >> >> >> cluster of
> >> >> >>>> machines.
> >> >> >>>> So ideally it may NOT be possible to run on a Mobile.
> >> >> >>>>
> >> >> >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <
> >> vigneshklncit@gmail.com>
> >> >> >>>> wrote:
> >> >> >>>>
> >> >> >>>>> I am trying to implement some classification in android mobile
> >> >> >> device..
> >> >> >>>>>
> >> >> >>>>> is it possible to use mahout in mobile device..Please kindly
> help
> >> me
> >> >> >>>>>
> >> >> >>>>> --
> >> >> >>>>> Thanks and Regards
> >> >> >>>>> Vignesh Srinivasan
> >> >> >>>>> 9739135640
> >> >> >>>>>
> >> >> >>>>
> >> >> >>>
> >> >> >>>
> >> >> >>>
> >> >> >>> --
> >> >> >>>
> >> >> >>> -jake
> >> >> >>
> >> >> >>
> >> >> >>
> >> >> >> --
> >> >> >> Thanks and Regards
> >> >> >> Vignesh Srinivasan
> >> >> >> 9739135640
> >> >> >>
> >> >> >
> >> >> >
> >> >> >
> >> >> > --
> >> >> >
> >> >> > -jake
> >> >>
> >> >>
> >> >
> >> >
> >> > --
> >> >
> >> > -jake
> >>
> >>
> >>
> >> --
> >> Thanks and Regards
> >> Vignesh Srinivasan
> >> 9739135640
> >>
> >
> >
> >
> > --
> >
> > -jake
>
>
>
> --
> Thanks and Regards
> Vignesh Srinivasan
> 9739135640
>
--
-jake
Re: can i run mahout algorithms on mobile device..
Posted by VIGNESH S <vi...@gmail.com>.
I am trying to classify mails
On Tue, Feb 5, 2013 at 12:10 AM, Jake Mannix <ja...@gmail.com> wrote:
> On Mon, Feb 4, 2013 at 12:53 AM, VIGNESH S <vi...@gmail.com> wrote:
>
>> Hi Jake,
>>
>> Thanks for your comments..
>>
>> What is understood from your comment is Incase of Training,we can use
>> hadoop in clusters to generate the trained model blob file..
>>
>
> Using a classifier has two steps: training the classifier (on data which
> has already been pre-labeled), and using the trained classifier on
> previously unlabeled items to predict the label which that item should
> have.
>
> Some Mahout algorithms can be trained on a Hadoop cluster, but in general
> are intended to be trained using large quantities of input data. The
> resultant serialized classifier file may be small, and this is what is used
> in the second step, and could conceivably fit on a mobile device.
>
>
>> We can use that trained model blob file in mobile device for
>> classification..
>>
>> is it possible to generate trained model blob file for all algorithms?
>>
>
> Not all algorithms even have simple single model files, no.
>
> What exactly are you trying to do on a mobile device?
>
>
>>
>>
>>
>>
>> On Sat, Feb 2, 2013 at 1:53 AM, Jake Mannix <ja...@gmail.com> wrote:
>> > On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com>
>> wrote:
>> >
>> >> Kind of off topic but why Mahout and not Weka and why on a mobile
>> device.
>> >>
>> >> Mahout is built to be scalable for large datasets, not something you'd
>> >> associate with a mobile device.
>> >
>> >
>> > Mahout scalability is about the *training set*. For example, you run a
>> > webmail service, you have tons and tons of spam and not-spam emails. You
>> > use Mahout to train a classifier on Hadoop using this training data, at
>> the
>> > end of the day, you spit out a sparse classifier model file, which could
>> > reasonably be a *very small* blob, under 100-1000KB.
>> >
>> >
>> >> On any mobile device you're going to run into memory issues very quickly
>> >> with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
>> >> allowed (i think).
>> >>
>> >> Personally I wouldn't even attempt such a thing, I'd off load the heavy
>> >> lifting to a server and simply have the client mobile device request
>> >> whatever it needed.
>> >>
>> >>
>> >> On 1 Feb 2013, at 14:55, Jake Mannix wrote:
>> >>
>> >> > Hi Vignesh,
>> >> >
>> >> > You've got a lot of steps to go through before you can start talking
>> >> > about putting it on your mobile device: you need to get your training
>> >> > data, train your classifier offline using Mahout, write code in your
>> >> mobile
>> >> > app which links to and uses the classifier package in Mahout that will
>> >> > understand how to use the serialized classifier data file, then make
>> sure
>> >> > your classifier data file is either bundled with your mobile app, or
>> else
>> >> > downloads it when it needs it.
>> >> >
>> >> > So first, you need to train a classifier (check out Mahout In Action
>> for
>> >> > more detailed instructions on this), it will result in a serialized
>> >> > classifier model on disk at the end of this process.
>> >> >
>> >> >
>> >> > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com>
>> >> wrote:
>> >> >
>> >> >> Hi ,
>> >> >>
>> >> >> Thanks for the reply..
>> >> >>
>> >> >> How can we make use of the training data done using Hadoop in mobile
>> >> >> phones..
>> >> >>
>> >> >> For Example,i can do some sort of serialization and store it on disk
>> >> >> and deserialize in mobile and use that data..
>> >> >>
>> >> >> is that possible or how can i use the training data without
>> connecting
>> >> >> to a hadoop cluster in real time..
>> >> >>
>> >> >>
>> >> >>
>> >> >> Thanks and Regards
>> >> >> Vignesh Srinivasan
>> >> >>
>> >> >>
>> >> >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
>> >> >> wrote:
>> >> >>> The *training* of many Mahout algorithms are on Hadoop, but the
>> output
>> >> >>> classifiers (e.g. a binary text classifier [trained with L1
>> >> >> regularization
>> >> >>> to sparsify] for spam filtering) could certainly fit on a small
>> >> footprint
>> >> >>> like a mobile phone.
>> >> >>>
>> >> >>>
>> >> >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
>> >> >>> <ba...@gmail.com>wrote:
>> >> >>>
>> >> >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
>> >> >>>> Also Hadoop is a distributed computing framework, it will run on
>> >> >> cluster of
>> >> >>>> machines.
>> >> >>>> So ideally it may NOT be possible to run on a Mobile.
>> >> >>>>
>> >> >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <
>> vigneshklncit@gmail.com>
>> >> >>>> wrote:
>> >> >>>>
>> >> >>>>> I am trying to implement some classification in android mobile
>> >> >> device..
>> >> >>>>>
>> >> >>>>> is it possible to use mahout in mobile device..Please kindly help
>> me
>> >> >>>>>
>> >> >>>>> --
>> >> >>>>> Thanks and Regards
>> >> >>>>> Vignesh Srinivasan
>> >> >>>>> 9739135640
>> >> >>>>>
>> >> >>>>
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> --
>> >> >>>
>> >> >>> -jake
>> >> >>
>> >> >>
>> >> >>
>> >> >> --
>> >> >> Thanks and Regards
>> >> >> Vignesh Srinivasan
>> >> >> 9739135640
>> >> >>
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> >
>> >> > -jake
>> >>
>> >>
>> >
>> >
>> > --
>> >
>> > -jake
>>
>>
>>
>> --
>> Thanks and Regards
>> Vignesh Srinivasan
>> 9739135640
>>
>
>
>
> --
>
> -jake
--
Thanks and Regards
Vignesh Srinivasan
9739135640
Re: can i run mahout algorithms on mobile device..
Posted by Jake Mannix <ja...@gmail.com>.
On Mon, Feb 4, 2013 at 12:53 AM, VIGNESH S <vi...@gmail.com> wrote:
> Hi Jake,
>
> Thanks for your comments..
>
> What is understood from your comment is Incase of Training,we can use
> hadoop in clusters to generate the trained model blob file..
>
Using a classifier has two steps: training the classifier (on data which
has already been pre-labeled), and using the trained classifier on
previously unlabeled items to predict the label which that item should
have.
Some Mahout algorithms can be trained on a Hadoop cluster, but in general
are intended to be trained using large quantities of input data. The
resultant serialized classifier file may be small, and this is what is used
in the second step, and could conceivably fit on a mobile device.
> We can use that trained model blob file in mobile device for
> classification..
>
> is it possible to generate trained model blob file for all algorithms?
>
Not all algorithms even have simple single model files, no.
What exactly are you trying to do on a mobile device?
>
>
>
>
> On Sat, Feb 2, 2013 at 1:53 AM, Jake Mannix <ja...@gmail.com> wrote:
> > On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com>
> wrote:
> >
> >> Kind of off topic but why Mahout and not Weka and why on a mobile
> device.
> >>
> >> Mahout is built to be scalable for large datasets, not something you'd
> >> associate with a mobile device.
> >
> >
> > Mahout scalability is about the *training set*. For example, you run a
> > webmail service, you have tons and tons of spam and not-spam emails. You
> > use Mahout to train a classifier on Hadoop using this training data, at
> the
> > end of the day, you spit out a sparse classifier model file, which could
> > reasonably be a *very small* blob, under 100-1000KB.
> >
> >
> >> On any mobile device you're going to run into memory issues very quickly
> >> with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
> >> allowed (i think).
> >>
> >> Personally I wouldn't even attempt such a thing, I'd off load the heavy
> >> lifting to a server and simply have the client mobile device request
> >> whatever it needed.
> >>
> >>
> >> On 1 Feb 2013, at 14:55, Jake Mannix wrote:
> >>
> >> > Hi Vignesh,
> >> >
> >> > You've got a lot of steps to go through before you can start talking
> >> > about putting it on your mobile device: you need to get your training
> >> > data, train your classifier offline using Mahout, write code in your
> >> mobile
> >> > app which links to and uses the classifier package in Mahout that will
> >> > understand how to use the serialized classifier data file, then make
> sure
> >> > your classifier data file is either bundled with your mobile app, or
> else
> >> > downloads it when it needs it.
> >> >
> >> > So first, you need to train a classifier (check out Mahout In Action
> for
> >> > more detailed instructions on this), it will result in a serialized
> >> > classifier model on disk at the end of this process.
> >> >
> >> >
> >> > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com>
> >> wrote:
> >> >
> >> >> Hi ,
> >> >>
> >> >> Thanks for the reply..
> >> >>
> >> >> How can we make use of the training data done using Hadoop in mobile
> >> >> phones..
> >> >>
> >> >> For Example,i can do some sort of serialization and store it on disk
> >> >> and deserialize in mobile and use that data..
> >> >>
> >> >> is that possible or how can i use the training data without
> connecting
> >> >> to a hadoop cluster in real time..
> >> >>
> >> >>
> >> >>
> >> >> Thanks and Regards
> >> >> Vignesh Srinivasan
> >> >>
> >> >>
> >> >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
> >> >> wrote:
> >> >>> The *training* of many Mahout algorithms are on Hadoop, but the
> output
> >> >>> classifiers (e.g. a binary text classifier [trained with L1
> >> >> regularization
> >> >>> to sparsify] for spam filtering) could certainly fit on a small
> >> footprint
> >> >>> like a mobile phone.
> >> >>>
> >> >>>
> >> >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
> >> >>> <ba...@gmail.com>wrote:
> >> >>>
> >> >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
> >> >>>> Also Hadoop is a distributed computing framework, it will run on
> >> >> cluster of
> >> >>>> machines.
> >> >>>> So ideally it may NOT be possible to run on a Mobile.
> >> >>>>
> >> >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <
> vigneshklncit@gmail.com>
> >> >>>> wrote:
> >> >>>>
> >> >>>>> I am trying to implement some classification in android mobile
> >> >> device..
> >> >>>>>
> >> >>>>> is it possible to use mahout in mobile device..Please kindly help
> me
> >> >>>>>
> >> >>>>> --
> >> >>>>> Thanks and Regards
> >> >>>>> Vignesh Srinivasan
> >> >>>>> 9739135640
> >> >>>>>
> >> >>>>
> >> >>>
> >> >>>
> >> >>>
> >> >>> --
> >> >>>
> >> >>> -jake
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Thanks and Regards
> >> >> Vignesh Srinivasan
> >> >> 9739135640
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> >
> >> > -jake
> >>
> >>
> >
> >
> > --
> >
> > -jake
>
>
>
> --
> Thanks and Regards
> Vignesh Srinivasan
> 9739135640
>
--
-jake
Re: can i run mahout algorithms on mobile device..
Posted by VIGNESH S <vi...@gmail.com>.
Hi Jake,
Thanks for your comments..
What is understood from your comment is Incase of Training,we can use
hadoop in clusters to generate the trained model blob file..
We can use that trained model blob file in mobile device for classification..
is it possible to generate trained model blob file for all algorithms?
On Sat, Feb 2, 2013 at 1:53 AM, Jake Mannix <ja...@gmail.com> wrote:
> On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com> wrote:
>
>> Kind of off topic but why Mahout and not Weka and why on a mobile device.
>>
>> Mahout is built to be scalable for large datasets, not something you'd
>> associate with a mobile device.
>
>
> Mahout scalability is about the *training set*. For example, you run a
> webmail service, you have tons and tons of spam and not-spam emails. You
> use Mahout to train a classifier on Hadoop using this training data, at the
> end of the day, you spit out a sparse classifier model file, which could
> reasonably be a *very small* blob, under 100-1000KB.
>
>
>> On any mobile device you're going to run into memory issues very quickly
>> with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
>> allowed (i think).
>>
>> Personally I wouldn't even attempt such a thing, I'd off load the heavy
>> lifting to a server and simply have the client mobile device request
>> whatever it needed.
>>
>>
>> On 1 Feb 2013, at 14:55, Jake Mannix wrote:
>>
>> > Hi Vignesh,
>> >
>> > You've got a lot of steps to go through before you can start talking
>> > about putting it on your mobile device: you need to get your training
>> > data, train your classifier offline using Mahout, write code in your
>> mobile
>> > app which links to and uses the classifier package in Mahout that will
>> > understand how to use the serialized classifier data file, then make sure
>> > your classifier data file is either bundled with your mobile app, or else
>> > downloads it when it needs it.
>> >
>> > So first, you need to train a classifier (check out Mahout In Action for
>> > more detailed instructions on this), it will result in a serialized
>> > classifier model on disk at the end of this process.
>> >
>> >
>> > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com>
>> wrote:
>> >
>> >> Hi ,
>> >>
>> >> Thanks for the reply..
>> >>
>> >> How can we make use of the training data done using Hadoop in mobile
>> >> phones..
>> >>
>> >> For Example,i can do some sort of serialization and store it on disk
>> >> and deserialize in mobile and use that data..
>> >>
>> >> is that possible or how can i use the training data without connecting
>> >> to a hadoop cluster in real time..
>> >>
>> >>
>> >>
>> >> Thanks and Regards
>> >> Vignesh Srinivasan
>> >>
>> >>
>> >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
>> >> wrote:
>> >>> The *training* of many Mahout algorithms are on Hadoop, but the output
>> >>> classifiers (e.g. a binary text classifier [trained with L1
>> >> regularization
>> >>> to sparsify] for spam filtering) could certainly fit on a small
>> footprint
>> >>> like a mobile phone.
>> >>>
>> >>>
>> >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
>> >>> <ba...@gmail.com>wrote:
>> >>>
>> >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
>> >>>> Also Hadoop is a distributed computing framework, it will run on
>> >> cluster of
>> >>>> machines.
>> >>>> So ideally it may NOT be possible to run on a Mobile.
>> >>>>
>> >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vi...@gmail.com>
>> >>>> wrote:
>> >>>>
>> >>>>> I am trying to implement some classification in android mobile
>> >> device..
>> >>>>>
>> >>>>> is it possible to use mahout in mobile device..Please kindly help me
>> >>>>>
>> >>>>> --
>> >>>>> Thanks and Regards
>> >>>>> Vignesh Srinivasan
>> >>>>> 9739135640
>> >>>>>
>> >>>>
>> >>>
>> >>>
>> >>>
>> >>> --
>> >>>
>> >>> -jake
>> >>
>> >>
>> >>
>> >> --
>> >> Thanks and Regards
>> >> Vignesh Srinivasan
>> >> 9739135640
>> >>
>> >
>> >
>> >
>> > --
>> >
>> > -jake
>>
>>
>
>
> --
>
> -jake
--
Thanks and Regards
Vignesh Srinivasan
9739135640
Re: can i run mahout algorithms on mobile device..
Posted by Jake Mannix <ja...@gmail.com>.
On Fri, Feb 1, 2013 at 7:19 AM, Chris Harrington <ch...@heystaks.com> wrote:
> Kind of off topic but why Mahout and not Weka and why on a mobile device.
>
> Mahout is built to be scalable for large datasets, not something you'd
> associate with a mobile device.
Mahout scalability is about the *training set*. For example, you run a
webmail service, you have tons and tons of spam and not-spam emails. You
use Mahout to train a classifier on Hadoop using this training data, at the
end of the day, you spit out a sparse classifier model file, which could
reasonably be a *very small* blob, under 100-1000KB.
> On any mobile device you're going to run into memory issues very quickly
> with any sizable dataset. Even the Galaxy s3 only has max 256mb heap
> allowed (i think).
>
> Personally I wouldn't even attempt such a thing, I'd off load the heavy
> lifting to a server and simply have the client mobile device request
> whatever it needed.
>
>
> On 1 Feb 2013, at 14:55, Jake Mannix wrote:
>
> > Hi Vignesh,
> >
> > You've got a lot of steps to go through before you can start talking
> > about putting it on your mobile device: you need to get your training
> > data, train your classifier offline using Mahout, write code in your
> mobile
> > app which links to and uses the classifier package in Mahout that will
> > understand how to use the serialized classifier data file, then make sure
> > your classifier data file is either bundled with your mobile app, or else
> > downloads it when it needs it.
> >
> > So first, you need to train a classifier (check out Mahout In Action for
> > more detailed instructions on this), it will result in a serialized
> > classifier model on disk at the end of this process.
> >
> >
> > On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com>
> wrote:
> >
> >> Hi ,
> >>
> >> Thanks for the reply..
> >>
> >> How can we make use of the training data done using Hadoop in mobile
> >> phones..
> >>
> >> For Example,i can do some sort of serialization and store it on disk
> >> and deserialize in mobile and use that data..
> >>
> >> is that possible or how can i use the training data without connecting
> >> to a hadoop cluster in real time..
> >>
> >>
> >>
> >> Thanks and Regards
> >> Vignesh Srinivasan
> >>
> >>
> >> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
> >> wrote:
> >>> The *training* of many Mahout algorithms are on Hadoop, but the output
> >>> classifiers (e.g. a binary text classifier [trained with L1
> >> regularization
> >>> to sparsify] for spam filtering) could certainly fit on a small
> footprint
> >>> like a mobile phone.
> >>>
> >>>
> >>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
> >>> <ba...@gmail.com>wrote:
> >>>
> >>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
> >>>> Also Hadoop is a distributed computing framework, it will run on
> >> cluster of
> >>>> machines.
> >>>> So ideally it may NOT be possible to run on a Mobile.
> >>>>
> >>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vi...@gmail.com>
> >>>> wrote:
> >>>>
> >>>>> I am trying to implement some classification in android mobile
> >> device..
> >>>>>
> >>>>> is it possible to use mahout in mobile device..Please kindly help me
> >>>>>
> >>>>> --
> >>>>> Thanks and Regards
> >>>>> Vignesh Srinivasan
> >>>>> 9739135640
> >>>>>
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>>
> >>> -jake
> >>
> >>
> >>
> >> --
> >> Thanks and Regards
> >> Vignesh Srinivasan
> >> 9739135640
> >>
> >
> >
> >
> > --
> >
> > -jake
>
>
--
-jake
Re: can i run mahout algorithms on mobile device..
Posted by Chris Harrington <ch...@heystaks.com>.
Kind of off topic but why Mahout and not Weka and why on a mobile device.
Mahout is built to be scalable for large datasets, not something you'd associate with a mobile device. On any mobile device you're going to run into memory issues very quickly with any sizable dataset. Even the Galaxy s3 only has max 256mb heap allowed (i think).
Personally I wouldn't even attempt such a thing, I'd off load the heavy lifting to a server and simply have the client mobile device request whatever it needed.
On 1 Feb 2013, at 14:55, Jake Mannix wrote:
> Hi Vignesh,
>
> You've got a lot of steps to go through before you can start talking
> about putting it on your mobile device: you need to get your training
> data, train your classifier offline using Mahout, write code in your mobile
> app which links to and uses the classifier package in Mahout that will
> understand how to use the serialized classifier data file, then make sure
> your classifier data file is either bundled with your mobile app, or else
> downloads it when it needs it.
>
> So first, you need to train a classifier (check out Mahout In Action for
> more detailed instructions on this), it will result in a serialized
> classifier model on disk at the end of this process.
>
>
> On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com> wrote:
>
>> Hi ,
>>
>> Thanks for the reply..
>>
>> How can we make use of the training data done using Hadoop in mobile
>> phones..
>>
>> For Example,i can do some sort of serialization and store it on disk
>> and deserialize in mobile and use that data..
>>
>> is that possible or how can i use the training data without connecting
>> to a hadoop cluster in real time..
>>
>>
>>
>> Thanks and Regards
>> Vignesh Srinivasan
>>
>>
>> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
>> wrote:
>>> The *training* of many Mahout algorithms are on Hadoop, but the output
>>> classifiers (e.g. a binary text classifier [trained with L1
>> regularization
>>> to sparsify] for spam filtering) could certainly fit on a small footprint
>>> like a mobile phone.
>>>
>>>
>>> On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
>>> <ba...@gmail.com>wrote:
>>>
>>>> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
>>>> Also Hadoop is a distributed computing framework, it will run on
>> cluster of
>>>> machines.
>>>> So ideally it may NOT be possible to run on a Mobile.
>>>>
>>>> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vi...@gmail.com>
>>>> wrote:
>>>>
>>>>> I am trying to implement some classification in android mobile
>> device..
>>>>>
>>>>> is it possible to use mahout in mobile device..Please kindly help me
>>>>>
>>>>> --
>>>>> Thanks and Regards
>>>>> Vignesh Srinivasan
>>>>> 9739135640
>>>>>
>>>>
>>>
>>>
>>>
>>> --
>>>
>>> -jake
>>
>>
>>
>> --
>> Thanks and Regards
>> Vignesh Srinivasan
>> 9739135640
>>
>
>
>
> --
>
> -jake
Re: can i run mahout algorithms on mobile device..
Posted by VIGNESH S <vi...@gmail.com>.
Thanks for the info jake..
On Fri, Feb 1, 2013 at 8:25 PM, Jake Mannix <ja...@gmail.com> wrote:
> Hi Vignesh,
>
> You've got a lot of steps to go through before you can start talking
> about putting it on your mobile device: you need to get your training
> data, train your classifier offline using Mahout, write code in your mobile
> app which links to and uses the classifier package in Mahout that will
> understand how to use the serialized classifier data file, then make sure
> your classifier data file is either bundled with your mobile app, or else
> downloads it when it needs it.
>
> So first, you need to train a classifier (check out Mahout In Action for
> more detailed instructions on this), it will result in a serialized
> classifier model on disk at the end of this process.
>
>
> On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com> wrote:
>
>> Hi ,
>>
>> Thanks for the reply..
>>
>> How can we make use of the training data done using Hadoop in mobile
>> phones..
>>
>> For Example,i can do some sort of serialization and store it on disk
>> and deserialize in mobile and use that data..
>>
>> is that possible or how can i use the training data without connecting
>> to a hadoop cluster in real time..
>>
>>
>>
>> Thanks and Regards
>> Vignesh Srinivasan
>>
>>
>> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
>> wrote:
>> > The *training* of many Mahout algorithms are on Hadoop, but the output
>> > classifiers (e.g. a binary text classifier [trained with L1
>> regularization
>> > to sparsify] for spam filtering) could certainly fit on a small footprint
>> > like a mobile phone.
>> >
>> >
>> > On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
>> > <ba...@gmail.com>wrote:
>> >
>> >> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
>> >> Also Hadoop is a distributed computing framework, it will run on
>> cluster of
>> >> machines.
>> >> So ideally it may NOT be possible to run on a Mobile.
>> >>
>> >> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vi...@gmail.com>
>> >> wrote:
>> >>
>> >> > I am trying to implement some classification in android mobile
>> device..
>> >> >
>> >> > is it possible to use mahout in mobile device..Please kindly help me
>> >> >
>> >> > --
>> >> > Thanks and Regards
>> >> > Vignesh Srinivasan
>> >> > 9739135640
>> >> >
>> >>
>> >
>> >
>> >
>> > --
>> >
>> > -jake
>>
>>
>>
>> --
>> Thanks and Regards
>> Vignesh Srinivasan
>> 9739135640
>>
>
>
>
> --
>
> -jake
--
Thanks and Regards
Vignesh Srinivasan
9739135640
Re: can i run mahout algorithms on mobile device..
Posted by Jake Mannix <ja...@gmail.com>.
Hi Vignesh,
You've got a lot of steps to go through before you can start talking
about putting it on your mobile device: you need to get your training
data, train your classifier offline using Mahout, write code in your mobile
app which links to and uses the classifier package in Mahout that will
understand how to use the serialized classifier data file, then make sure
your classifier data file is either bundled with your mobile app, or else
downloads it when it needs it.
So first, you need to train a classifier (check out Mahout In Action for
more detailed instructions on this), it will result in a serialized
classifier model on disk at the end of this process.
On Thu, Jan 31, 2013 at 10:23 PM, VIGNESH S <vi...@gmail.com> wrote:
> Hi ,
>
> Thanks for the reply..
>
> How can we make use of the training data done using Hadoop in mobile
> phones..
>
> For Example,i can do some sort of serialization and store it on disk
> and deserialize in mobile and use that data..
>
> is that possible or how can i use the training data without connecting
> to a hadoop cluster in real time..
>
>
>
> Thanks and Regards
> Vignesh Srinivasan
>
>
> On Thu, Jan 31, 2013 at 7:43 AM, Jake Mannix <ja...@gmail.com>
> wrote:
> > The *training* of many Mahout algorithms are on Hadoop, but the output
> > classifiers (e.g. a binary text classifier [trained with L1
> regularization
> > to sparsify] for spam filtering) could certainly fit on a small footprint
> > like a mobile phone.
> >
> >
> > On Wed, Jan 30, 2013 at 7:46 AM, Mahesh Balija
> > <ba...@gmail.com>wrote:
> >
> >> AFAIK it is NOT possible. As Mahout runs on top of Hadoop.
> >> Also Hadoop is a distributed computing framework, it will run on
> cluster of
> >> machines.
> >> So ideally it may NOT be possible to run on a Mobile.
> >>
> >> On Wed, Jan 30, 2013 at 8:46 PM, VIGNESH S <vi...@gmail.com>
> >> wrote:
> >>
> >> > I am trying to implement some classification in android mobile
> device..
> >> >
> >> > is it possible to use mahout in mobile device..Please kindly help me
> >> >
> >> > --
> >> > Thanks and Regards
> >> > Vignesh Srinivasan
> >> > 9739135640
> >> >
> >>
> >
> >
> >
> > --
> >
> > -jake
>
>
>
> --
> Thanks and Regards
> Vignesh Srinivasan
> 9739135640
>
--
-jake