You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Goel, Ankur" <An...@corp.aol.com> on 2008/06/27 15:06:50 UTC
Using value aggregator framework with MultipleTextOutputFormat
Hi All,
Has anyone used value aggregator framework with
MultipleTextOutputFormat ?
The javadoc presently lists TextOutputFormat and
SequenceFileOutputFormat as the options.
What I want to do is specify different aggregator plugins and based upon
the key names collect
output to different text files.
Thanks
-Ankur
RE: Using value aggregator framework with MultipleTextOutputFormat
Posted by Runping Qi <ru...@yahoo-inc.com>.
Right.
Please open a Jira for that.
Runping
> -----Original Message-----
> From: Goel, Ankur [mailto:Ankur.Goel@corp.aol.com]
> Sent: Friday, June 27, 2008 6:33 AM
> To: core-user@hadoop.apache.org
> Subject: RE: Using value aggregator framework with
> MultipleTextOutputFormat
>
> I guess I made a mistake. After having a look at the source code it
> looks like there is a choice between input format (sequence or text)
but
> the output format is hardcoded to be text. That is something that can
be
> improved.
>
> -----Original Message-----
> From: Goel, Ankur [mailto:Ankur.Goel@corp.aol.com]
> Sent: Friday, June 27, 2008 6:37 PM
> To: core-user@hadoop.apache.org
> Subject: Using value aggregator framework with
MultipleTextOutputFormat
>
> Hi All,
> Has anyone used value aggregator framework with
> MultipleTextOutputFormat ?
> The javadoc presently lists TextOutputFormat and
> SequenceFileOutputFormat as the options.
>
> What I want to do is specify different aggregator plugins and based
upon
> the key names collect output to different text files.
>
> Thanks
> -Ankur
RE: Using value aggregator framework with MultipleTextOutputFormat
Posted by "Goel, Ankur" <An...@corp.aol.com>.
I guess I made a mistake. After having a look at the source code it
looks like there is a choice between input format (sequence or text) but
the output format is hardcoded to be text. That is something that can be
improved.
-----Original Message-----
From: Goel, Ankur [mailto:Ankur.Goel@corp.aol.com]
Sent: Friday, June 27, 2008 6:37 PM
To: core-user@hadoop.apache.org
Subject: Using value aggregator framework with MultipleTextOutputFormat
Hi All,
Has anyone used value aggregator framework with
MultipleTextOutputFormat ?
The javadoc presently lists TextOutputFormat and
SequenceFileOutputFormat as the options.
What I want to do is specify different aggregator plugins and based upon
the key names collect output to different text files.
Thanks
-Ankur