[jira] [Created] (MAPREDUCE-7278) Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative are false

["Tarun Parimi (Jira)" <ji...@apache.org>]

Tarun Parimi created MAPREDUCE-7278:
---------------------------------------

             Summary: Speculative execution behavior is observed even when mapreduce.map.speculative and mapreduce.reduce.speculative are false
                 Key: MAPREDUCE-7278
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7278
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: task
    Affects Versions: 2.8.0
            Reporter: Tarun Parimi
         Attachments: Screen Shot 2020-04-30 at 8.04.27 PM.png

When a failed task attempt container is stuck in FAIL_FINISHING_CONTAINER state for some time, we observe two task attempts are launched simultaneously even when speculative execution is disabled.

This results in the below message shown in the killed attempts, indicating speculation has occurred. This is an issue for jobs which require speculative execution to be strictly disabled.

  !Screen Shot 2020-04-30 at 8.04.27 PM.png!

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org