You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by abc xyz <fa...@yahoo.com> on 2010/07/08 11:13:14 UTC
naming the output fle of reduce to the partition number
Hi Everyone,
I am having some problem with naming the output file of each reduce task with
the partition number. First of all, how can I get the partition number within
each reduce? Second, How am I going to name the output file with that partition
number?
I have looked to the MultipleTextOutputFormat. It can generate a new file with
the name of my choice for each key. But I want to name the output file for each
partition with the name of my choice i.e. with the partition number.
Please help me in this regard.
Thanks