You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Harsh J <qw...@gmail.com> on 2011/04/01 09:37:38 UTC
Re: sorting reducer input numerically in hadoop streaming
You will need to supply your own Key-comparator Java class by setting
an appropriate parameter for it, as noted in:
http://hadoop.apache.org/common/docs/r0.20.2/streaming.html#A+Useful+Comparator+Class
[The -D mapred.output.key.comparator.class=xyz part]
On Thu, Mar 31, 2011 at 6:26 PM, Dieter Plaetinck
<di...@intec.ugent.be> wrote:
> couldn't find how I should do that.
--
Harsh J
http://harshj.com
Re: sorting reducer input numerically in hadoop streaming
Posted by Dieter Plaetinck <di...@intec.ugent.be>.
Thank you Harsh,
that works fine!
(looks like the page I was looking at was the same, but for an older
version of hadoop)
Dieter
On Fri, 1 Apr 2011 13:07:38 +0530
Harsh J <qw...@gmail.com> wrote:
> You will need to supply your own Key-comparator Java class by setting
> an appropriate parameter for it, as noted in:
> http://hadoop.apache.org/common/docs/r0.20.2/streaming.html#A+Useful+Comparator+Class
> [The -D mapred.output.key.comparator.class=xyz part]
>
> On Thu, Mar 31, 2011 at 6:26 PM, Dieter Plaetinck
> <di...@intec.ugent.be> wrote:
> > couldn't find how I should do that.
>