You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by sl...@apache.org on 2024/01/26 05:44:41 UTC
(hadoop) branch branch-3.4 updated: HADOOP-19051: Highlight Capacity Scheduler new features in release for the release 3.4.0 (#6500) Contributed by Benjamin Teke.
This is an automated email from the ASF dual-hosted git repository.
slfan1989 pushed a commit to branch branch-3.4
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/branch-3.4 by this push:
new 7212fbf7ffa9 HADOOP-19051: Highlight Capacity Scheduler new features in release for the release 3.4.0 (#6500) Contributed by Benjamin Teke.
7212fbf7ffa9 is described below
commit 7212fbf7ffa98f29de831b72eb4f3825babdf8f1
Author: Benjamin Teke <br...@users.noreply.github.com>
AuthorDate: Fri Jan 26 06:33:55 2024 +0100
HADOOP-19051: Highlight Capacity Scheduler new features in release for the release 3.4.0 (#6500) Contributed by Benjamin Teke.
Signed-off-by: Shilun Fan <sl...@apache.org>
---
hadoop-project/src/site/markdown/index.md.vm | 21 +++++++++++++++++++++
1 file changed, 21 insertions(+)
diff --git a/hadoop-project/src/site/markdown/index.md.vm b/hadoop-project/src/site/markdown/index.md.vm
index f3f9c41deb5c..7c1b3ef5eb40 100644
--- a/hadoop-project/src/site/markdown/index.md.vm
+++ b/hadoop-project/src/site/markdown/index.md.vm
@@ -57,6 +57,27 @@ We have enhanced the YARN Federation functionality for improved usability. The e
6. The page function of the router has been enhanced.
7. A set of commands has been added to the Router side for operating on SubClusters and Policies.
+YARN Capacity Scheduler improvements
+----------------------------------------
+
+[YARN-10496](https://issues.apache.org/jira/browse/YARN-10496) Support Flexible Auto Queue Creation in Capacity Scheduler
+
+Capacity Scheduler resource distribution mode was extended with a new allocation mode called weight mode.
+Defining queue capacities with weights allows the users to use the newly added flexible queue auto creation mode.
+Flexible mode now supports the dynamic creation of both **parent queues** and **leaf queues**, enabling the creation of
+complex queue hierarchies application submission time.
+
+[YARN-10888](https://issues.apache.org/jira/browse/YARN-10888) New capacity modes for Capacity Scheduler
+
+Capacity Scheduler's resource distribution was completely refactored to be more flexible and extensible. There is a new concept
+called Capacity Vectors, which allows the users to mix various resource types in the hierarchy, and also in a single queue. With
+this optionally enabled feature it is now possible to define different resources with different units, like memory with GBs, vcores with
+percentage values, and GPUs/FPGAs with weights, all in the same queue.
+
+[YARN-10889](https://issues.apache.org/jira/browse/YARN-10889) Queue Creation in Capacity Scheduler - Various improvements
+
+In addition to the two new features above, there were a number of commits for improvements and bug fixes in Capacity Scheduler.
+
HDFS RBF: Code Enhancements, New Features, and Bug Fixes
----------------------------------------
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org