You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by Wasim Bari <wa...@msn.com> on 2009/09/07 12:54:48 UTC

Stop mapper in middle

 

Hi,

   Is there some way to return control from MAP funtion and complete the job.

 

I am searching a file and when i get my required data i want mappers to stop rather than seraching the remaning part.

 

Thanks. 

 

Wasim

Re: Stop mapper in middle

Posted by Enis Soztutar <en...@gmail.com>.

Hi,

Currently there is no way to signal a message to the map/reducer tasks. 
The issue was closed as won't fix.

What you can do for now, is for example periodically check for a 
existence of a file in HDFS and if the file is present, just return from 
all map tasks.

Wasim Bari wrote:
>  
>
> Hi,
>
>    Is there some way to return control from MAP funtion and complete the job.
>
>  
>
> I am searching a file and when i get my required data i want mappers to stop rather than seraching the remaning part.
>
>  
>
> Thanks. 
>
>  
>
> Wasim 
>
>