You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by slitz <sl...@gmail.com> on 2008/06/25 20:13:56 UTC
MultipleOutputFormat example
Hello,
I need the reduce to output to different files depending on the key, after
reading some jira entries and some previous threads of the mailing list i
think that the MultipleTextOutputFormat class would fit my needs, the
problem is that i can't find any example of how to use it.
Could someone please show me a quick example of how to use this class or
MultipleOutputFormat subclasses in general? i'm somewhat lost...
slitz
Re: MultipleOutputFormat example
Posted by slitz <sl...@gmail.com>.
Hello,
I just did! Thank you! And indeed it is A LOT easier, or maybe it's just the
included snippets that help a lot, or maybe both things help :)
Although i would still like to learn how to use
MultipleOutputFormat/MultipleTextOutputFormat since it should be more
flexible and i whould like to know how to use this kind of things in hadoop
as this could help me understand other classes and patterns.
So it would be great if someone could give me an example of how to use it.
slitz
On Wed, Jun 25, 2008 at 7:53 PM, montag <mk...@about.com> wrote:
>
> Hi,
>
> You should check out the MultipleOutputs thread and patch of
> https://issues.apache.org/jira/browse/HADOOP-3149 HADOOP-3149 There are
> some relevant and useful code snippets that address the issue of splitting
> output to multiple files within the discussion as well as in the patch
> documentation. I found implementing this patch easier than dealing with
> MultipleTextOutputFormat.
>
> Cheers,
> Mike
>
>
>
> slitz wrote:
> >
> > Hello,
> > I need the reduce to output to different files depending on the key,
> after
> > reading some jira entries and some previous threads of the mailing list i
> > think that the MultipleTextOutputFormat class would fit my needs, the
> > problem is that i can't find any example of how to use it.
> >
> > Could someone please show me a quick example of how to use this class or
> > MultipleOutputFormat subclasses in general? i'm somewhat lost...
> >
> > slitz
> >
> >
>
> --
> View this message in context:
> http://www.nabble.com/MultipleOutputFormat-example-tp18118780p18119478.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>
Re: MultipleOutputFormat example
Posted by montag <mk...@about.com>.
Hi,
You should check out the MultipleOutputs thread and patch of
https://issues.apache.org/jira/browse/HADOOP-3149 HADOOP-3149 There are
some relevant and useful code snippets that address the issue of splitting
output to multiple files within the discussion as well as in the patch
documentation. I found implementing this patch easier than dealing with
MultipleTextOutputFormat.
Cheers,
Mike
slitz wrote:
>
> Hello,
> I need the reduce to output to different files depending on the key, after
> reading some jira entries and some previous threads of the mailing list i
> think that the MultipleTextOutputFormat class would fit my needs, the
> problem is that i can't find any example of how to use it.
>
> Could someone please show me a quick example of how to use this class or
> MultipleOutputFormat subclasses in general? i'm somewhat lost...
>
> slitz
>
>
--
View this message in context: http://www.nabble.com/MultipleOutputFormat-example-tp18118780p18119478.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.