You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Tao Yang (Jira)" <ji...@apache.org> on 2019/09/07 00:34:00 UTC
[jira] [Comment Edited] (YARN-8995) Log events info in
AsyncDispatcher when event queue size cumulatively reaches a certain number
every time.
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924672#comment-16924672 ]
Tao Yang edited comment on YARN-8995 at 9/7/19 12:33 AM:
---------------------------------------------------------
Thanks [~jhung] for fixing this problem, sorry for missing changes about logger class in branch-3.1 and branch-3.2.
Failures in jenkins report are cased by running environment, unrelated to the patch.
Patch LGTM and already tested in my local environment. Committing shortly.
was (Author: tao yang):
Thanks [~jhung] for fixing this problem, sorry for missing changes about logger class in branch-3.1.
Patch LGTM and already tested in my local environment. Committing shortly.
> Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.
> ----------------------------------------------------------------------------------------------------------
>
> Key: YARN-8995
> URL: https://issues.apache.org/jira/browse/YARN-8995
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: metrics, nodemanager, resourcemanager
> Affects Versions: 3.2.0, 3.3.0
> Reporter: zhuqi
> Assignee: zhuqi
> Priority: Major
> Fix For: 3.3.0, 3.2.1, 3.1.3
>
> Attachments: TestStreamPerf.java, YARN-8995-branch-3.1.001.patch.addendum, YARN-8995.001.patch, YARN-8995.002.patch, YARN-8995.003.patch, YARN-8995.004.patch, YARN-8995.005.patch, YARN-8995.006.patch, YARN-8995.007.patch, YARN-8995.008.patch, YARN-8995.009.patch, YARN-8995.010.patch, YARN-8995.011.patch, YARN-8995.012.patch, YARN-8995.013.patch, YARN-8995.014.patch, YARN-8995.015.patch, YARN-8995.016.patch, image-2019-09-04-15-20-02-914.png
>
>
> In our growing cluster，there are unexpected situations that cause some event queues to block the performance of the cluster, such as the bug of https://issues.apache.org/jira/browse/YARN-5262 . I think it's necessary to log the event type of the too big event queue size, and add the information to the metrics, and the threshold of queue size is a parametor which can be changed.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org