You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by ch...@apache.org on 2024/06/06 06:12:30 UTC
(yunikorn-site) branch master updated: [YUNIKORN-2462] incorrect gang annotations in example (#422)
This is an automated email from the ASF dual-hosted git repository.
chenyulin0719 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/yunikorn-site.git
The following commit(s) were added to refs/heads/master by this push:
new 6720e9c418 [YUNIKORN-2462] incorrect gang annotations in example (#422)
6720e9c418 is described below
commit 6720e9c4185ae979169389b961eacafda89847cb
Author: steinsgateted <st...@gmail.com>
AuthorDate: Thu Jun 6 14:11:30 2024 +0800
[YUNIKORN-2462] incorrect gang annotations in example (#422)
Closes: #422
Signed-off-by: Yu-Lin Chen <ch...@apache.org>
---
docs/user_guide/gang_scheduling.md | 49 ++++++++++++++++++--------------------
1 file changed, 23 insertions(+), 26 deletions(-)
diff --git a/docs/user_guide/gang_scheduling.md b/docs/user_guide/gang_scheduling.md
index 1b8dd24bf2..f96bbe7996 100644
--- a/docs/user_guide/gang_scheduling.md
+++ b/docs/user_guide/gang_scheduling.md
@@ -180,32 +180,29 @@ Each Spark job runs 2 types of pods, driver and executor. Hence, we need to defi
The annotations for the driver pod looks like:
```yaml
-Annotations:
- yunikorn.apache.org/schedulingPolicyParameters: “placeholderTimeoutSeconds=30”
- yunikorn.apache.org/taskGroupName: “spark-driver”
- yunikorn.apache.org/taskGroup: “
- TaskGroups: [
- {
- Name: “spark-driver”,
- minMember: 1,
- minResource: {
- Cpu: 1,
- Memory: 2Gi
- },
- Node-selector: ...,
- Tolerations: ...,
- Affinity: ...
+annotations:
+ yunikorn.apache.org/schedulingPolicyParameters: "placeholderTimeoutInSeconds=30 gangSchedulingStyle=Hard"
+ yunikorn.apache.org/task-group-name: "spark-driver"
+ yunikorn.apache.org/task-groups: |-
+ [{
+ "name": "spark-driver",
+ "minMember": 1,
+ "minResource": {
+ "cpu": "1",
+ "memory": "2Gi"
+ },
+ "nodeSelector": {},
+ "tolerations": [],
+ "affinity": {}
},
- {
- Name: “spark-executor”,
- minMember: 10,
- minResource: {
- Cpu: 1,
- Memory: 2Gi
+ {
+ "name": "spark-executor",
+ "minMember": 1,
+ "minResource": {
+ "cpu": "1",
+ "memory": "2Gi"
}
- }
- ]
- ”
+ }]
```
:::note
@@ -216,10 +213,10 @@ See the [Spark documentation](https://spark.apache.org/docs/latest/configuration
For all the executor pods,
```yaml
-Annotations:
+annotations:
# the taskGroup name should match to the names
# defined in the taskGroups field
- yunikorn.apache.org/taskGroupName: “spark-executor”
+ yunikorn.apache.org/task-group-name: "spark-executor"
```
Once the job is submitted to the scheduler, the job won’t be scheduled immediately.
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org