[jira] [Created] (YARN-10497) Fix an issue in CapacityScheduler which fails to delete queues

["Wangda Tan (Jira)" <ji...@apache.org>]

Wangda Tan created YARN-10497:
---------------------------------

             Summary: Fix an issue in CapacityScheduler which fails to delete queues
                 Key: YARN-10497
                 URL: https://issues.apache.org/jira/browse/YARN-10497
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Wangda Tan


We saw an exception when using queue mutation APIs:
{code:java}
2020-11-13 16:47:46,327 WARN org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices: CapacityScheduler configuration validation failed:java.io.IOException: Queue root.am2cmQueueSecond not found
{code}
Which comes from this code:
{code:java}
        List<String> siblingQueues = getSiblingQueues(queueToRemove,
            proposedConf);
        if (!siblingQueues.contains(queueName)) {
          throw new IOException("Queue " + queueToRemove + " not found");
        } 
{code}
(Inside MutableCSConfigurationProvider)

If you look at the method:
{code:java}
 
  private List<String> getSiblingQueues(String queuePath, Configuration conf) {
    String parentQueue = queuePath.substring(0, queuePath.lastIndexOf('.'));
    String childQueuesKey = CapacitySchedulerConfiguration.PREFIX +
        parentQueue + CapacitySchedulerConfiguration.DOT +
        CapacitySchedulerConfiguration.QUEUES;
    return new ArrayList<>(conf.getStringCollection(childQueuesKey));
  }
{code}
And here's capacity-scheduler.xml I got
{code:java}
<property><name>yarn.scheduler.capacity.root.queues</name><value>default, q1, q2</value></property>
{code}
You can notice there're spaces between default, q1, a2

So conf.getStringCollection returns:
{code:java}
default
<space>q1
...
{code}
Which causes match issue when we try to delete the queue.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org