You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amol Kekre (Created) (JIRA)" <ji...@apache.org> on 2012/01/06 03:15:40 UTC
[jira] [Created] (MAPREDUCE-3629) Remove sleep from MRAppMaster
during app-finish.
Remove sleep from MRAppMaster during app-finish.
------------------------------------------------
Key: MAPREDUCE-3629
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3629
Project: Hadoop Map/Reduce
Issue Type: Task
Components: mrv2
Affects Versions: 0.23.0
Reporter: Amol Kekre
Fix For: 0.23.1
MRAppMaster waits for 5 secs during app-finish, this was needed before we had
client-side redirection. This affects the app execution in that, AppMaster will killed by the NM once NM gets
confirmation from RM.
AppMaster should go away immediately. Also, the done call to RM from AM should be the last thing AM ever does.
Otherwise, today, JobHistory writing gets interrupted if AM gets killed by the NM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3629) Remove sleep from MRAppMaster
during app-finish.
Posted by "Amol Kekre (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13181047#comment-13181047 ]
Amol Kekre commented on MAPREDUCE-3629:
---------------------------------------
Vinod,
Can you check this and comment (close if this is resolved)
> Remove sleep from MRAppMaster during app-finish.
> ------------------------------------------------
>
> Key: MAPREDUCE-3629
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3629
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Amol Kekre
> Fix For: 0.23.1
>
>
> MRAppMaster waits for 5 secs during app-finish, this was needed before we had
> client-side redirection. This affects the app execution in that, AppMaster will killed by the NM once NM gets
> confirmation from RM.
> AppMaster should go away immediately. Also, the done call to RM from AM should be the last thing AM ever does.
> Otherwise, today, JobHistory writing gets interrupted if AM gets killed by the NM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3629) Remove sleep from MRAppMaster
during app-finish.
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-3629:
-----------------------------------------------
Priority: Major (was: Critical)
That unnecessary sleep still exists but it isn't really a critical issue. I suspect it isn't straightforward too, have to be careful with tests etc.
> Remove sleep from MRAppMaster during app-finish.
> ------------------------------------------------
>
> Key: MAPREDUCE-3629
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3629
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Amol Kekre
> Fix For: 0.23.1
>
>
> MRAppMaster waits for 5 secs during app-finish, this was needed before we had
> client-side redirection. This affects the app execution in that, AppMaster will killed by the NM once NM gets
> confirmation from RM.
> AppMaster should go away immediately. Also, the done call to RM from AM should be the last thing AM ever does.
> Otherwise, today, JobHistory writing gets interrupted if AM gets killed by the NM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3629) Remove sleep from MRAppMaster
during app-finish.
Posted by "Arun C Murthy (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-3629:
-------------------------------------
Fix Version/s: (was: 0.23.1)
0.24.0
> Remove sleep from MRAppMaster during app-finish.
> ------------------------------------------------
>
> Key: MAPREDUCE-3629
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3629
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Amol Kekre
> Fix For: 0.24.0
>
>
> MRAppMaster waits for 5 secs during app-finish, this was needed before we had
> client-side redirection. This affects the app execution in that, AppMaster will killed by the NM once NM gets
> confirmation from RM.
> AppMaster should go away immediately. Also, the done call to RM from AM should be the last thing AM ever does.
> Otherwise, today, JobHistory writing gets interrupted if AM gets killed by the NM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3629) Remove sleep from MRAppMaster
during app-finish.
Posted by "Amol Kekre (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amol Kekre updated MAPREDUCE-3629:
----------------------------------
Priority: Critical (was: Major)
> Remove sleep from MRAppMaster during app-finish.
> ------------------------------------------------
>
> Key: MAPREDUCE-3629
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3629
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Amol Kekre
> Priority: Critical
> Fix For: 0.23.1
>
>
> MRAppMaster waits for 5 secs during app-finish, this was needed before we had
> client-side redirection. This affects the app execution in that, AppMaster will killed by the NM once NM gets
> confirmation from RM.
> AppMaster should go away immediately. Also, the done call to RM from AM should be the last thing AM ever does.
> Otherwise, today, JobHistory writing gets interrupted if AM gets killed by the NM.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira