You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by syed kather <in...@gmail.com> on 2012/07/23 19:52:36 UTC
Basic Question on Partitioner,Combiner and Co-Processor
Hi ,
I am very much interested to know how to implement the custom
Partitioner . Is there any blog let me know . As i knew the number of
reducer is depends upon the partitioner . Correct me if i am wrong
How to implement Co-Processor(Min,Max) . Is there any tutorial available on
implementing Co-Processor . This is the first time i am working with
Co-Processor.
How to use combiner in HBase ( Trying to write the Map-Reduce Program for
finding the Max Value from the HBase Columns )?
Thanks in advance ..
Thanks and Regards,
S SYED ABDUL KATHER
Re: Basic Question on Partitioner,Combiner and Co-Processor
Posted by shashwat shriparv <dw...@gmail.com>.
Check out this link too..
http://sharepointorange.blogspot.in/2012/07/how-to-working-with-hbase-coprocessor.html
On Tue, Jul 24, 2012 at 12:09 AM, syed kather <in...@gmail.com> wrote:
> In my use case i have Mapper function which emit <userid,seqid>. Number of
> Map will be around 10 billion X 2000 user . which is best partition method
> which i can follow for my use case ?. Sorry i am first time writing my
> partition . So i have this doubt .
>
> Thanks in advance
>
> S SYED ABDUL KATHER
>
>
>
> On Tue, Jul 24, 2012 at 12:03 AM, syed kather <in...@gmail.com> wrote:
>
> > Thanks Shashwat Shriparv..
> > Is there any interface or abstract class partitioner avaliable for hbase
> > specifically ..
> > Thanks and Regards,
> > S SYED ABDUL KATHER
> >
> >
> >
> > On Mon, Jul 23, 2012 at 11:54 PM, shashwat shriparv <
> > dwivedishashwat@gmail.com> wrote:
> >
> >> Check out this link may be will help you..
> >>
> >> http://developer.yahoo.com/hadoop/tutorial/module5.html#partitioning
> >>
> >>
> http://www.ashishpaliwal.com/blog/2012/05/hadoop-recipe-implementing-custom-partitioner/
> >>
> >>
> >> Regards
> >>
> >>
> >> ∞
> >> Shashwat Shriparv
> >>
> >>
> >>
> >> On Mon, Jul 23, 2012 at 11:22 PM, syed kather <in...@gmail.com>
> wrote:
> >>
> >> > Hi ,
> >> >
> >> > I am very much interested to know how to implement the custom
> >> > Partitioner . Is there any blog let me know . As i knew the number of
> >> > reducer is depends upon the partitioner . Correct me if i am wrong
> >> >
> >> > How to implement Co-Processor(Min,Max) . Is there any tutorial
> >> available on
> >> > implementing Co-Processor . This is the first time i am working with
> >> > Co-Processor.
> >> >
> >> > How to use combiner in HBase ( Trying to write the Map-Reduce Program
> >> for
> >> > finding the Max Value from the HBase Columns )?
> >> >
> >> > Thanks in advance ..
> >> > Thanks and Regards,
> >> > S SYED ABDUL KATHER
> >> >
> >>
> >>
> >>
> >> --
> >>
> >>
> >> ∞
> >> Shashwat Shriparv
> >>
> >
> >
>
--
∞
Shashwat Shriparv
Re: Basic Question on Partitioner,Combiner and Co-Processor
Posted by syed kather <in...@gmail.com>.
In my use case i have Mapper function which emit <userid,seqid>. Number of
Map will be around 10 billion X 2000 user . which is best partition method
which i can follow for my use case ?. Sorry i am first time writing my
partition . So i have this doubt .
Thanks in advance
S SYED ABDUL KATHER
On Tue, Jul 24, 2012 at 12:03 AM, syed kather <in...@gmail.com> wrote:
> Thanks Shashwat Shriparv..
> Is there any interface or abstract class partitioner avaliable for hbase
> specifically ..
> Thanks and Regards,
> S SYED ABDUL KATHER
>
>
>
> On Mon, Jul 23, 2012 at 11:54 PM, shashwat shriparv <
> dwivedishashwat@gmail.com> wrote:
>
>> Check out this link may be will help you..
>>
>> http://developer.yahoo.com/hadoop/tutorial/module5.html#partitioning
>>
>> http://www.ashishpaliwal.com/blog/2012/05/hadoop-recipe-implementing-custom-partitioner/
>>
>>
>> Regards
>>
>>
>> ∞
>> Shashwat Shriparv
>>
>>
>>
>> On Mon, Jul 23, 2012 at 11:22 PM, syed kather <in...@gmail.com> wrote:
>>
>> > Hi ,
>> >
>> > I am very much interested to know how to implement the custom
>> > Partitioner . Is there any blog let me know . As i knew the number of
>> > reducer is depends upon the partitioner . Correct me if i am wrong
>> >
>> > How to implement Co-Processor(Min,Max) . Is there any tutorial
>> available on
>> > implementing Co-Processor . This is the first time i am working with
>> > Co-Processor.
>> >
>> > How to use combiner in HBase ( Trying to write the Map-Reduce Program
>> for
>> > finding the Max Value from the HBase Columns )?
>> >
>> > Thanks in advance ..
>> > Thanks and Regards,
>> > S SYED ABDUL KATHER
>> >
>>
>>
>>
>> --
>>
>>
>> ∞
>> Shashwat Shriparv
>>
>
>
Re: Basic Question on Partitioner,Combiner and Co-Processor
Posted by syed kather <in...@gmail.com>.
Thanks Shashwat Shriparv..
Is there any interface or abstract class partitioner avaliable for hbase
specifically ..
Thanks and Regards,
S SYED ABDUL KATHER
On Mon, Jul 23, 2012 at 11:54 PM, shashwat shriparv <
dwivedishashwat@gmail.com> wrote:
> Check out this link may be will help you..
>
> http://developer.yahoo.com/hadoop/tutorial/module5.html#partitioning
>
> http://www.ashishpaliwal.com/blog/2012/05/hadoop-recipe-implementing-custom-partitioner/
>
>
> Regards
>
>
> ∞
> Shashwat Shriparv
>
>
>
> On Mon, Jul 23, 2012 at 11:22 PM, syed kather <in...@gmail.com> wrote:
>
> > Hi ,
> >
> > I am very much interested to know how to implement the custom
> > Partitioner . Is there any blog let me know . As i knew the number of
> > reducer is depends upon the partitioner . Correct me if i am wrong
> >
> > How to implement Co-Processor(Min,Max) . Is there any tutorial available
> on
> > implementing Co-Processor . This is the first time i am working with
> > Co-Processor.
> >
> > How to use combiner in HBase ( Trying to write the Map-Reduce Program for
> > finding the Max Value from the HBase Columns )?
> >
> > Thanks in advance ..
> > Thanks and Regards,
> > S SYED ABDUL KATHER
> >
>
>
>
> --
>
>
> ∞
> Shashwat Shriparv
>
Re: Basic Question on Partitioner,Combiner and Co-Processor
Posted by shashwat shriparv <dw...@gmail.com>.
Check out this link may be will help you..
http://developer.yahoo.com/hadoop/tutorial/module5.html#partitioning
http://www.ashishpaliwal.com/blog/2012/05/hadoop-recipe-implementing-custom-partitioner/
Regards
∞
Shashwat Shriparv
On Mon, Jul 23, 2012 at 11:22 PM, syed kather <in...@gmail.com> wrote:
> Hi ,
>
> I am very much interested to know how to implement the custom
> Partitioner . Is there any blog let me know . As i knew the number of
> reducer is depends upon the partitioner . Correct me if i am wrong
>
> How to implement Co-Processor(Min,Max) . Is there any tutorial available on
> implementing Co-Processor . This is the first time i am working with
> Co-Processor.
>
> How to use combiner in HBase ( Trying to write the Map-Reduce Program for
> finding the Max Value from the HBase Columns )?
>
> Thanks in advance ..
> Thanks and Regards,
> S SYED ABDUL KATHER
>
--
∞
Shashwat Shriparv