You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Lakshmi Manasa Gaduputi (Jira)" <ji...@apache.org> on 2020/02/07 00:00:00 UTC
[jira] [Commented] (YARN-3238) Connection timeouts to nodemanagers
are retried at multiple levels
[ https://issues.apache.org/jira/browse/YARN-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032029#comment-17032029 ]
Lakshmi Manasa Gaduputi commented on YARN-3238:
-----------------------------------------------
this patch is not available in 3.0.0-alpha1 [branch-3.0.0-alpha1|[https://github.com/apache/hadoop/blob/branch-3.0.0-alpha1/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/ServerProxy.java#L80]] and [release-3.0.0-alpha1 |[https://github.com/apache/hadoop/blob/release-3.0.0-alpha1-RC0/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/client/ServerProxy.java#L80]].
A lot of the versions do not have this patch. Is there a reason for not pulling it into higher versions? Did something underlying change so as to NOT need this patch?
> Connection timeouts to nodemanagers are retried at multiple levels
> ------------------------------------------------------------------
>
> Key: YARN-3238
> URL: https://issues.apache.org/jira/browse/YARN-3238
> Project: Hadoop YARN
> Issue Type: Bug
> Affects Versions: 2.6.0
> Reporter: Jason Darrell Lowe
> Assignee: Jason Darrell Lowe
> Priority: Blocker
> Labels: 2.6.1-candidate
> Fix For: 2.7.0, 2.6.1, 3.0.0-alpha1
>
> Attachments: YARN-3238.001.patch
>
>
> The IPC layer will retry connection timeouts automatically (see Client.java), but we are also retrying them with YARN's RetryPolicy put in place when the NM proxy is created. This causes a two-level retry mechanism where the IPC layer has already retried quite a few times (45 by default) for each YARN RetryPolicy error that is retried. The end result is that NM clients can wait a very, very long time for the connection to finally fail.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org