You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Keren Ouaknine <ke...@gmail.com> on 2011/04/27 14:03:27 UTC

Task speculation

Hello,

So I am activating task speculation on my cluster, bad luck and the task
which was duplicated falls on another straggler.
Will it be duplicated again or does it have a special status as a
speculative task?

Thanks,
Keren

-- 
Keren Ouaknine
Cell: +972 54 2565404
Web: www.kereno.com

Re: Task speculation

Posted by Harsh J <ha...@cloudera.com>.
Hey Keren,

On Wed, Apr 27, 2011 at 5:33 PM, Keren Ouaknine <ke...@gmail.com> wrote:
> Hello,
>
> So I am activating task speculation on my cluster, bad luck and the task
> which was duplicated falls on another straggler.
> Will it be duplicated again or does it have a special status as a
> speculative task?

I believe the failures of speculative tasks come under the normal task
failure situations, and that there isn't really a special status
assigned to these tasks. So yes, if the conditions for speculative is
acceptable in further TT heartbeats + the Task hasn't reported
completion yet, a new speculative task will be launched.

-- 
Harsh J