You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@yunikorn.apache.org by "Mit Desai (Jira)" <ji...@apache.org> on 2025/09/02 20:40:00 UTC
[jira] [Created] (YUNIKORN-3118) Implement Parallel TryNode Evaluation for Improved Scheduling Performance
Mit Desai created YUNIKORN-3118:
-----------------------------------
Summary: Implement Parallel TryNode Evaluation for Improved Scheduling Performance
Key: YUNIKORN-3118
URL: https://issues.apache.org/jira/browse/YUNIKORN-3118
Project: Apache YuniKorn
Issue Type: Improvement
Components: core - scheduler
Reporter: Mit Desai
Assignee: Mit Desai
h3. Summary
Implement parallel evaluation of nodes during the scheduling process to significantly improve scheduling latency in large clusters. This enhancement introduces configurable parallelization of the TryNode evaluation process while maintaining backward compatibility.
h3. Background
In large Kubernetes clusters with many nodes, the current sequential node evaluation process can become a bottleneck during scheduling. Each allocation request must evaluate nodes one by one, leading to increased scheduling latency, especially when dealing with multiple pending pods.
h3. Proposed Solution
Add a new configuration parameter `trynodesthreadcount` that allows us to configure the number of parallel threads used for node evaluation during scheduling.
h3. Key Features:
1. {*}Configurable Parallelism{*}: New `trynodesthreadcount` parameter in partition configuration
2. {*}Backward Compatibility{*}: Defaults to sequential behavior (value = 1) when not configured
3. {*}Thread Safety{*}: Proper synchronization using goroutines and semaphores
4. {*}Performance Optimization{*}: Implements dry-run evaluation before actual allocation attempts
Configuration Example:
{code:yaml}
partitions:
name: default
trynodesthreadcount: 20 # Enable parallel evaluation with 20 threads
queues: name: root
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@yunikorn.apache.org
For additional commands, e-mail: issues-help@yunikorn.apache.org