You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "slfan1989 (via GitHub)" <gi...@apache.org> on 2023/05/09 14:38:46 UTC

[GitHub] [hadoop] slfan1989 commented on pull request #5625: YARN-3660. BackPort [GPG] Federation Global Policy Generator (service hook only).

slfan1989 commented on PR #5625:
URL: https://github.com/apache/hadoop/pull/5625#issuecomment-1540257264

   @goiri In the [YARN-Federation](https://hadoop.apache.org/docs/r3.3.5/hadoop-yarn/hadoop-yarn-site/Federation.html) documentation, it is mentioned that there is a `Global Policy Generator` component and its code exists in the `YARN-7402` branch. Therefore, we need to backport the code from the `YARN-7402`  branch to the `trunk` branch.
   
   I try to backport `YARN-3660` from the `YARN-7402` branch to the `trunk` branch. During the backport process, I mostly kept the original code and fixed issues flagged by Spotbugs.  
   
   I have compiled a list of Jira issues that need to be backported in the future.  I will submit `5-6` pull requests to backport this code to the trunk branch. 
   
   The list is as follows.  (These prs have already been merged into the `YARN-7402` branch.)
   - YARN-3360 [GPG] Federation Global Policy Generator (service hook only)
   - YARN-6648 [GPG] Add SubClusterCleaner in Global Policy Generator
   - YARN-7599 [GPG] ApplicationCleaner in Global Policy Generator
   - YARN-7707 [GPG] Policy generator framework
   - YARN-7708 [GPG] Load based policy generator
   - YARN-8334 [GPG] Fix potential connection leak in GPGUtils
   - YARN-8534 [GPG] Add max heap config option for Federation GPG
   - YARN-8637 [GPG] Add FederationStateStore getAppInfo API for GlobalPolicyGenerator
   - YARN-8862 [GPG] Add Yarn Registry cleanup in ApplicationCleaner
   - YARN-8934 [GPG] Add JvmMetricsInfo and pause monitor
   - YARN-9013 [GPG] fix order of steps cleaning Registry entries in ApplicationCleaner
   
   
   Can you help to merge this pr into the trunk branch? Thank you very much! I will continue to follow up the backport of other PRs.
   The issue with the unit tests is not caused by our pr.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org