You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Goel, Ankur" <An...@corp.aol.com> on 2008/06/27 15:06:50 UTC

Using value aggregator framework with MultipleTextOutputFormat

Hi All,
        Has anyone used value aggregator framework with
MultipleTextOutputFormat ? 
The javadoc presently lists TextOutputFormat and
SequenceFileOutputFormat as the options.
 
What I want to do is specify different aggregator plugins and based upon
the key names collect
output to different text files.
 
Thanks
-Ankur

RE: Using value aggregator framework with MultipleTextOutputFormat

Posted by Runping Qi <ru...@yahoo-inc.com>.
Right.

Please open a Jira for that.

Runping


> -----Original Message-----
> From: Goel, Ankur [mailto:Ankur.Goel@corp.aol.com]
> Sent: Friday, June 27, 2008 6:33 AM
> To: core-user@hadoop.apache.org
> Subject: RE: Using value aggregator framework with
> MultipleTextOutputFormat
> 
> I guess I made a mistake. After having a look at the source code it
> looks like there is a choice between input format (sequence or text)
but
> the output format is hardcoded to be text. That is something that can
be
> improved.
> 
> -----Original Message-----
> From: Goel, Ankur [mailto:Ankur.Goel@corp.aol.com]
> Sent: Friday, June 27, 2008 6:37 PM
> To: core-user@hadoop.apache.org
> Subject: Using value aggregator framework with
MultipleTextOutputFormat
> 
> Hi All,
>         Has anyone used value aggregator framework with
> MultipleTextOutputFormat ?
> The javadoc presently lists TextOutputFormat and
> SequenceFileOutputFormat as the options.
> 
> What I want to do is specify different aggregator plugins and based
upon
> the key names collect output to different text files.
> 
> Thanks
> -Ankur

RE: Using value aggregator framework with MultipleTextOutputFormat

Posted by "Goel, Ankur" <An...@corp.aol.com>.
I guess I made a mistake. After having a look at the source code it
looks like there is a choice between input format (sequence or text) but
the output format is hardcoded to be text. That is something that can be
improved.

-----Original Message-----
From: Goel, Ankur [mailto:Ankur.Goel@corp.aol.com] 
Sent: Friday, June 27, 2008 6:37 PM
To: core-user@hadoop.apache.org
Subject: Using value aggregator framework with MultipleTextOutputFormat

Hi All,
        Has anyone used value aggregator framework with
MultipleTextOutputFormat ? 
The javadoc presently lists TextOutputFormat and
SequenceFileOutputFormat as the options.
 
What I want to do is specify different aggregator plugins and based upon
the key names collect output to different text files.
 
Thanks
-Ankur