You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Shannon Quinn <sq...@gatech.edu> on 2010/07/22 21:21:02 UTC
mahout.common.Pair writable?
Hi all,
Quick question: I'd like to make use of the Pair object in a map/reduce
task, but I see it only implements the Serializable interface, not the
Writable interface. Would it be terribly forward if I offered to make that
modification?
Thanks!
Shannon
Re: mahout.common.Pair writable?
Posted by Drew Farris <dr...@gmail.com>.
IntPairWritable might be helpful in this vein as well, it implements
BinaryComparable which means it doesn't have to be transformed from a
byte[] back to a int,int to be sorted which ends up saving a
significant amount of time in the shuffle.
On Mon, Jul 26, 2010 at 9:44 AM, Ted Dunning <te...@gmail.com> wrote:
> That can be tricky. Look for GenericWritable.
>
> On Mon, Jul 26, 2010 at 6:25 AM, Shannon Quinn <sq...@gatech.edu> wrote:
>
>> 'm unsure how to make a generic class implement Writable.
>
Re: mahout.common.Pair writable?
Posted by Ted Dunning <te...@gmail.com>.
That can be tricky. Look for GenericWritable.
On Mon, Jul 26, 2010 at 6:25 AM, Shannon Quinn <sq...@gatech.edu> wrote:
> 'm unsure how to make a generic class implement Writable.
Re: mahout.common.Pair writable?
Posted by Shannon Quinn <sq...@gatech.edu>.
Ah, that is an excellent point - it is core. I suppose the route I took,
then - simply writing an IntDoubleWritable class - is probably the best
option, as I'm unsure how to make a generic class implement Writable.
On Fri, Jul 23, 2010 at 3:29 AM, Sean Owen <sr...@gmail.com> wrote:
> Is this class in core/ or math/? I forget and I'm away from the source.
> The idea is that core/ should not depend on Hadoop at all.
>
> On Thu, Jul 22, 2010 at 10:21 PM, Shannon Quinn <sq...@gatech.edu> wrote:
> > Hi all,
> >
> > Quick question: I'd like to make use of the Pair object in a map/reduce
> > task, but I see it only implements the Serializable interface, not the
> > Writable interface. Would it be terribly forward if I offered to make
> that
> > modification?
> >
> > Thanks!
> >
> > Shannon
> >
>
Re: mahout.common.Pair writable?
Posted by Sean Owen <sr...@gmail.com>.
Is this class in core/ or math/? I forget and I'm away from the source.
The idea is that core/ should not depend on Hadoop at all.
On Thu, Jul 22, 2010 at 10:21 PM, Shannon Quinn <sq...@gatech.edu> wrote:
> Hi all,
>
> Quick question: I'd like to make use of the Pair object in a map/reduce
> task, but I see it only implements the Serializable interface, not the
> Writable interface. Would it be terribly forward if I offered to make that
> modification?
>
> Thanks!
>
> Shannon
>