You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@pig.apache.org by "Palleti, Pallavi" <pa...@corp.aol.com> on 2009/09/02 11:25:46 UTC

Turning off speculative execution in Pig

Hi all,

 

Is there a provision to turn off speculative execution in Pig similar to
hadoop. If yes, can someone kindly let me know how to do that. I tried
to search over the web but couldn't find any useful information.

 

Thanks

Pallavi

Re: Turning off speculative execution in Pig

Posted by Mridul Muralidharan <mr...@yahoo-inc.com>.

You might want to set both

mapred.reduce.tasks.speculative.execution
and
mapred.map.tasks.speculative.execution

to false.


Regards,
Mridul

Ashutosh Chauhan wrote:
> Try adding  -Dmapred.map.tasks.speculative.execution=false to command used
> to launch pig.
> 
> Ashutosh
> 
> On Wed, Sep 2, 2009 at 05:25, Palleti, Pallavi <pallavi.palleti@corp.aol.com
>> wrote:
> 
>> Hi all,
>>
>>
>>
>> Is there a provision to turn off speculative execution in Pig similar to
>> hadoop. If yes, can someone kindly let me know how to do that. I tried
>> to search over the web but couldn't find any useful information.
>>
>>
>>
>> Thanks
>>
>> Pallavi
>>
>>
>

Re: Turning off speculative execution in Pig

Posted by Ashutosh Chauhan <as...@gmail.com>.

Try adding  -Dmapred.map.tasks.speculative.execution=false to command used
to launch pig.

Ashutosh

On Wed, Sep 2, 2009 at 05:25, Palleti, Pallavi <pallavi.palleti@corp.aol.com
> wrote:

> Hi all,
>
>
>
> Is there a provision to turn off speculative execution in Pig similar to
> hadoop. If yes, can someone kindly let me know how to do that. I tried
> to search over the web but couldn't find any useful information.
>
>
>
> Thanks
>
> Pallavi
>
>