MultiOutputs for TextFileTarget like AvroPathPerKeyTarget

[Suyash Agarwal <ss...@gmail.com>]

Hi,

We have a use-case to have multiple outputs emitted from MR job. I couldn't
find an implementation for Text (similar to AvroPathPerKeyTarget). So I
wrote a target and OutputFormat implementation for the same.
If the idea looks okay, I'd like to commit it to the core code.

Thanks.

Re: MultiOutputs for TextFileTarget like AvroPathPerKeyTarget

[Clément MATHIEU <cl...@unportant.info>]

On Tue, 2019-07-02 at 08:02 +0530, Suyash Agarwal wrote:
> We have a use-case to have multiple outputs emitted from MR job. I
> couldn't find an implementation for Text (similar to
> AvroPathPerKeyTarget). So I wrote a target and OutputFormat
> implementation for the same. If the idea looks okay, I'd like to
> commit it to the core code.

+1

We faced the same gap a while back and also hacked something but didn't
bothered to polish & upstream it. It would be a great addition.

Re: MultiOutputs for TextFileTarget like AvroPathPerKeyTarget

[Josh Wills <jo...@gmail.com>]

That would be wonderful, thank you!

On Mon, Jul 1, 2019 at 8:03 PM Suyash Agarwal <ss...@gmail.com> wrote:

> Hi,
>
> We have a use-case to have multiple outputs emitted from MR job. I couldn't
> find an implementation for Text (similar to AvroPathPerKeyTarget). So I
> wrote a target and OutputFormat implementation for the same.
> If the idea looks okay, I'd like to commit it to the core code.
>
> Thanks.
>