You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-user@hadoop.apache.org by Kim Ebert <ki...@reflectivedevelopment.com> on 2011/11/18 20:13:47 UTC

context.write in cleanup?

I was wondering if a context.write is possible in the cleanup of a Mapper.

For example, if the map function queues the item in an external process, 
and then in the cleanup phase all the results from the external process 
are mapped.

 From looking at how the map reduce process works, I would think this is 
possible.

Thanks,

Kim

Re: context.write in cleanup?

Posted by Kim Ebert <ki...@reflectivedevelopment.com>.

Thanks for your help Harsh.

Kim

On 11/18/2011 12:18 PM, Harsh J wrote:
> Kim,
>
> Yes.
>
> See the discussion at http://search-hadoop.com/m/jzO0k18XoNW1
>
> On 19-Nov-2011, at 12:43 AM, Kim Ebert wrote:
>
>> I was wondering if a context.write is possible in the cleanup of a Mapper.
>>
>> For example, if the map function queues the item in an external process, and then in the cleanup phase all the results from the external process are mapped.
>>
>>  From looking at how the map reduce process works, I would think this is possible.
>>
>> Thanks,
>>
>> Kim
>

Re: context.write in cleanup?

Posted by Harsh J <ha...@cloudera.com>.

Kim,

Yes.

See the discussion at http://search-hadoop.com/m/jzO0k18XoNW1

On 19-Nov-2011, at 12:43 AM, Kim Ebert wrote:

> I was wondering if a context.write is possible in the cleanup of a Mapper.
> 
> For example, if the map function queues the item in an external process, and then in the cleanup phase all the results from the external process are mapped.
> 
> From looking at how the map reduce process works, I would think this is possible.
> 
> Thanks,
> 
> Kim