You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "zhuqi (JIRA)" <ji...@apache.org> on 2019/05/17 17:11:00 UTC
[jira] [Commented] (YARN-8995) Log the event type of the too big
AsyncDispatcher event queue size, and add the information to the metrics.
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16842320#comment-16842320 ]
zhuqi commented on YARN-8995:
-----------------------------
cc [~leftnoteasy], [~sunilg], [~Tao Yang], [~tangzhankun], [~jiwq]
Hi all:
Sorry for the late response.
If you have any advice about the first draft patch, which adds the two log info:
1.The map records the event type counters details of the too many events in the blocking event queue, now i hard code to 5000. And if we need print the event type size in order?
2.The latest event being dispatched, which may be the root cause of the too many queued events.
Thanks a lot.
> Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.
> ------------------------------------------------------------------------------------------------------------
>
> Key: YARN-8995
> URL: https://issues.apache.org/jira/browse/YARN-8995
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: metrics, nodemanager, resourcemanager
> Affects Versions: 3.2.0
> Reporter: zhuqi
> Assignee: zhuqi
> Priority: Major
> Attachments: YARN-8995.001.patch
>
>
> In our growing cluster，there are unexpected situations that cause some event queues to block the performance of the cluster, such as the bug of https://issues.apache.org/jira/browse/YARN-5262 . I think it's necessary to log the event type of the too big event queue size, and add the information to the metrics, and the threshold of queue size is a parametor which can be changed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org