You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Bilwa S T (Jira)" <ji...@apache.org> on 2020/08/04 06:41:00 UTC
[jira] [Commented] (MAPREDUCE-6726) YARN Registry based AM
discovery with retry and in-flight task persistent via JHS
[ https://issues.apache.org/jira/browse/MAPREDUCE-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17170590#comment-17170590 ]
Bilwa S T commented on MAPREDUCE-6726:
--------------------------------------
Hi [~srikanth.sampath]
me and [~dmmkr] would like to work on this further if you are okay with it
> YARN Registry based AM discovery with retry and in-flight task persistent via JHS
> ---------------------------------------------------------------------------------
>
> Key: MAPREDUCE-6726
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6726
> Project: Hadoop Map/Reduce
> Issue Type: Sub-task
> Components: applicationmaster
> Reporter: Junping Du
> Assignee: Srikanth Sampath
> Priority: Major
> Attachments: MAPREDUCE-6726-MAPREDUCE-6608.001.patch, MAPREDUCE-6726-MAPREDUCE-6608.001.patch, MAPREDUCE-6726-MAPREDUCE-6608.002.patch, MAPREDUCE-6726-MAPREDUCE-6608.003.patch, WorkPreservingMRAppMaster.pdf
>
>
> Several tasks will be achieved in this JIRA based on the demo patch in MAPREDUCE-6608:
> 1. AM discovery base on YARN register service. Could be replaced by YARN-4758 later due to scale up issue.
> 2. Retry logic for TaskUmbilicalProtocol RPC connection
> 3. In-flight task recover after AM restart via JHS
> 4. Configuration to control the behavior compatible with previous when not enable this feature (by default).
> All security related issues and other concerns discussed in MAPREDUCE-6608 will be addressed in follow up JIRAs.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org