[jira] [Commented] (YARN-8459) Improve logs of Capacity Scheduler to better debug invalid states

["Tao Yang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16529637#comment-16529637 ] 

Tao Yang commented on YARN-8459:
--------------------------------

Hi, [~leftnoteasy]. 
Can we improve the skip queue log in ParentQueue#assignContainers? In async-scheduling mode, there are too many such debug logs (thousands every second) and may generate several new log files every minute when there is no pending request on the root queue. I think this log can be printed at periodic intervals.
{code:java}
    if (!super.hasPendingResourceRequest(candidates.getPartition(),
        clusterResource, schedulingMode)) {
      if (LOG.isDebugEnabled()) {
        LOG.debug("Skip this queue=" + getQueuePath()
            + ", because it doesn't need more resource, schedulingMode="
            + schedulingMode.name() + " node-partition=" + candidates
            .getPartition());
      }
     ...
   }
{code}

> Improve logs of Capacity Scheduler to better debug invalid states
> -----------------------------------------------------------------
>
>                 Key: YARN-8459
>                 URL: https://issues.apache.org/jira/browse/YARN-8459
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: capacity scheduler
>    Affects Versions: 3.1.0
>            Reporter: Wangda Tan
>            Assignee: Wangda Tan
>            Priority: Major
>         Attachments: YARN-8459.001.patch, YARN-8459.002.patch, YARN-8459.003.patch
>
>
> Improve logs in CS to better debug invalid states



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org