You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Chaman Singh Verma <cs...@yahoo.com> on 2008/04/16 17:07:22 UTC
Backup Tasks in Hadoop MapReduce.
Hello,
I am curious to know whether Hadoop MapReduce has the feature of "Backup
Tasks" as described in the
seminal paper "MapReduce:Simplified Data Processing in Large Cluster" ( Dean
and Ghemawat ).
Any implementation detail will be extremely valuable.
Thanks.
With Regards.
Chaman Singh Verma
Poona,India
-----
Chaman Singh Verma
Poona, India
--
View this message in context: http://www.nabble.com/Backup-Tasks-in-Hadoop-MapReduce.-tp16722539p16722539.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
Re: Backup Tasks in Hadoop MapReduce.
Posted by Ted Dunning <td...@veoh.com>.
I believe that this is turned on by default (at least in 15).
On 4/16/08 10:57 AM, "Milind Bhandarkar" <mi...@yahoo-inc.com> wrote:
> Yes. In hadoop, you can enable "backup" tasks by setting
> mapred.speculative.execution to true.
>
> - milind
>
>
> On 4/16/08 8:07 AM, "Chaman Singh Verma" <cs...@yahoo.com> wrote:
>
>>
>>
>> Hello,
>>
>> I am curious to know whether Hadoop MapReduce has the feature of "Backup
>> Tasks" as described in the
>> seminal paper "MapReduce:Simplified Data Processing in Large Cluster" ( Dean
>> and Ghemawat ).
>>
>> Any implementation detail will be extremely valuable.
>>
>> Thanks.
>>
>> With Regards.
>> Chaman Singh Verma
>> Poona,India
>>
>> -----
>> Chaman Singh Verma
>> Poona, India
>> --
>> View this message in context:
>>
http://www.nabble.com/Backup-Tasks-in-Hadoop-MapReduce.-tp16722539p16722539.h>>
t
>> ml
>> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>>
>
> - Milind
Re: Backup Tasks in Hadoop MapReduce.
Posted by Milind Bhandarkar <mi...@yahoo-inc.com>.
Yes. In hadoop, you can enable "backup" tasks by setting
mapred.speculative.execution to true.
- milind
On 4/16/08 8:07 AM, "Chaman Singh Verma" <cs...@yahoo.com> wrote:
>
>
> Hello,
>
> I am curious to know whether Hadoop MapReduce has the feature of "Backup
> Tasks" as described in the
> seminal paper "MapReduce:Simplified Data Processing in Large Cluster" ( Dean
> and Ghemawat ).
>
> Any implementation detail will be extremely valuable.
>
> Thanks.
>
> With Regards.
> Chaman Singh Verma
> Poona,India
>
> -----
> Chaman Singh Verma
> Poona, India
> --
> View this message in context:
> http://www.nabble.com/Backup-Tasks-in-Hadoop-MapReduce.-tp16722539p16722539.ht
> ml
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
- Milind
--
Milind Bhandarkar, Chief Spammer, Grid Team
Y!IM: GridSolutions
408-349-2136
(milindb@yahoo-inc.com)