You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by Fernando Santos <fe...@gmail.com> on 2013/09/20 13:57:32 UTC
Mahout in one PC - multiple cores processor
Hello everyone,
I'm working with some classification tasks that are taking long time do be
processed. So looking for a solution I found Mahout.
Does anyone know if using Mahout without any cluster, just in my computer,
it gives better performance than not using it? I mean, is it possible to
treat the different cores of my computer's processor as they were a cluster
of other machines?
Thanks!
--
Fernando Santos
+55 61 8129 8505
Re: Mahout in one PC - multiple cores processor
Posted by Ted Dunning <te...@gmail.com>.
Just runs in one process.
Sent from my iPhone
On Sep 20, 2013, at 11:32, Fernando Santos <fe...@gmail.com> wrote:
> Thanks for the help guys.
>
> But these parts of Mahout that don't work with Hadoop also works with some
> other distributed file system or it just runs in one process?
>
>
>
> 2013/9/20 Ted Dunning <te...@gmail.com>
>
>> It also depends on what you are doing. Several parts of Mahout have non
>> Hadoop versions.
>>
>>
>> On Fri, Sep 20, 2013 at 5:53 AM, parnab kumar <pa...@gmail.com>
>> wrote:
>>
>>> It is always possible to run mahout without a cluster on a single machine
>>> but donot expect too much performance gain on it if you are using a huge
>>> data set.Such a set up is primarily meant for development and testing
>>> purpose on small datasets. If you have a machine with many cores , you
>> can
>>> configure hadoop in pseudo cluster mode and then point mahout to hadoop
>>> directory . Set the number of map and reduce slots in the hadoop conf
>> file
>>> to properly utilize the cores of your processor.
>>>
>>> Thanks,
>>> Parnab
>>>
>>>
>>> On Fri, Sep 20, 2013 at 5:27 PM, Fernando Santos <
>>> fernandoleandro1991@gmail.com> wrote:
>>>
>>>> Hello everyone,
>>>>
>>>> I'm working with some classification tasks that are taking long time do
>>> be
>>>> processed. So looking for a solution I found Mahout.
>>>>
>>>> Does anyone know if using Mahout without any cluster, just in my
>>> computer,
>>>> it gives better performance than not using it? I mean, is it possible
>> to
>>>> treat the different cores of my computer's processor as they were a
>>> cluster
>>>> of other machines?
>>>>
>>>> Thanks!
>>>>
>>>> --
>>>> Fernando Santos
>>>> +55 61 8129 8505
>
>
>
> --
> Fernando Santos
> +55 61 8129 8505
Re: Mahout in one PC - multiple cores processor
Posted by Fernando Santos <fe...@gmail.com>.
Thanks for the help guys.
But these parts of Mahout that don't work with Hadoop also works with some
other distributed file system or it just runs in one process?
2013/9/20 Ted Dunning <te...@gmail.com>
> It also depends on what you are doing. Several parts of Mahout have non
> Hadoop versions.
>
>
> On Fri, Sep 20, 2013 at 5:53 AM, parnab kumar <pa...@gmail.com>
> wrote:
>
> > It is always possible to run mahout without a cluster on a single machine
> > but donot expect too much performance gain on it if you are using a huge
> > data set.Such a set up is primarily meant for development and testing
> > purpose on small datasets. If you have a machine with many cores , you
> can
> > configure hadoop in pseudo cluster mode and then point mahout to hadoop
> > directory . Set the number of map and reduce slots in the hadoop conf
> file
> > to properly utilize the cores of your processor.
> >
> > Thanks,
> > Parnab
> >
> >
> > On Fri, Sep 20, 2013 at 5:27 PM, Fernando Santos <
> > fernandoleandro1991@gmail.com> wrote:
> >
> > > Hello everyone,
> > >
> > > I'm working with some classification tasks that are taking long time do
> > be
> > > processed. So looking for a solution I found Mahout.
> > >
> > > Does anyone know if using Mahout without any cluster, just in my
> > computer,
> > > it gives better performance than not using it? I mean, is it possible
> to
> > > treat the different cores of my computer's processor as they were a
> > cluster
> > > of other machines?
> > >
> > > Thanks!
> > >
> > > --
> > > Fernando Santos
> > > +55 61 8129 8505
> > >
> >
>
--
Fernando Santos
+55 61 8129 8505
Re: Mahout in one PC - multiple cores processor
Posted by Ted Dunning <te...@gmail.com>.
It also depends on what you are doing. Several parts of Mahout have non
Hadoop versions.
On Fri, Sep 20, 2013 at 5:53 AM, parnab kumar <pa...@gmail.com> wrote:
> It is always possible to run mahout without a cluster on a single machine
> but donot expect too much performance gain on it if you are using a huge
> data set.Such a set up is primarily meant for development and testing
> purpose on small datasets. If you have a machine with many cores , you can
> configure hadoop in pseudo cluster mode and then point mahout to hadoop
> directory . Set the number of map and reduce slots in the hadoop conf file
> to properly utilize the cores of your processor.
>
> Thanks,
> Parnab
>
>
> On Fri, Sep 20, 2013 at 5:27 PM, Fernando Santos <
> fernandoleandro1991@gmail.com> wrote:
>
> > Hello everyone,
> >
> > I'm working with some classification tasks that are taking long time do
> be
> > processed. So looking for a solution I found Mahout.
> >
> > Does anyone know if using Mahout without any cluster, just in my
> computer,
> > it gives better performance than not using it? I mean, is it possible to
> > treat the different cores of my computer's processor as they were a
> cluster
> > of other machines?
> >
> > Thanks!
> >
> > --
> > Fernando Santos
> > +55 61 8129 8505
> >
>
Re: Mahout in one PC - multiple cores processor
Posted by parnab kumar <pa...@gmail.com>.
It is always possible to run mahout without a cluster on a single machine
but donot expect too much performance gain on it if you are using a huge
data set.Such a set up is primarily meant for development and testing
purpose on small datasets. If you have a machine with many cores , you can
configure hadoop in pseudo cluster mode and then point mahout to hadoop
directory . Set the number of map and reduce slots in the hadoop conf file
to properly utilize the cores of your processor.
Thanks,
Parnab
On Fri, Sep 20, 2013 at 5:27 PM, Fernando Santos <
fernandoleandro1991@gmail.com> wrote:
> Hello everyone,
>
> I'm working with some classification tasks that are taking long time do be
> processed. So looking for a solution I found Mahout.
>
> Does anyone know if using Mahout without any cluster, just in my computer,
> it gives better performance than not using it? I mean, is it possible to
> treat the different cores of my computer's processor as they were a cluster
> of other machines?
>
> Thanks!
>
> --
> Fernando Santos
> +55 61 8129 8505
>