You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "András Győri (Jira)" <ji...@apache.org> on 2022/06/09 09:11:00 UTC

[jira] [Created] (YARN-11174) Setting user limit factor on dynamic queues at runtime does not propagate to ConfigurationProperties

András Győri created YARN-11174:
-----------------------------------

             Summary: Setting user limit factor on dynamic queues at runtime does not propagate to ConfigurationProperties
                 Key: YARN-11174
                 URL: https://issues.apache.org/jira/browse/YARN-11174
             Project: Hadoop YARN
          Issue Type: Bug
          Components: capacity scheduler
            Reporter: András Győri
            Assignee: András Győri


YARN-10838 introduced a ConfigurationProperties class, that is optimised for fast prefixed retrievals. However, changes at runtime on a CSConfig object will not have effect on this cache. The only way to propagate those changes is to reinitialise the entire cache, which could be costly. 

In order to avoid unnecessary operations, we need a way to add new entries to the ConfigurationProperties in constant time.

In addition to this, YARN-11006 implemented a way for dynamic queues to be able to override user limit factors via templates. However, this only worked because of the missing propagations, hence it is a bug in the logic that should be fixed.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org