[jira] Commented: (HADOOP-1542) Speculative execution used when property set to false

["Nigel Daley (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12508733 ] 

Nigel Daley commented on HADOOP-1542:
-------------------------------------

Is it possible that setting speculation off in mapred-default.xml on my job submission host has no effect and that i really need to set it off in hadoop-site.xml?  

If that is the case, then speculation would be on -- which explains perfectly the immediate execution of task_0005_m_000004_1.  In which case this should be filed as a dfs bug since the file created by the first map (task_0005_m_000004_0) is getting lost.

> Speculative execution used when property set to false
> -----------------------------------------------------
>
>                 Key: HADOOP-1542
>                 URL: https://issues.apache.org/jira/browse/HADOOP-1542
>             Project: Hadoop
>          Issue Type: Bug
>          Components: mapred
>            Reporter: Nigel Daley
>         Attachments: jobtracker.log, namenode.log
>
>
> Speculative execution is now on by default.  When running TestDFSIO, I set speculative execution off in my mapred-default.xml since this test has maps that create files in DFS (side-effects).  
> However, it seems that speculative tasks get started even though I have set speculation off.  I'll attached the NN and JT logs.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.