You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "zhengchenyu (Jira)" <ji...@apache.org> on 2022/05/13 08:51:00 UTC
[jira] [Updated] (YARN-10775) Federation: Yarn running app web can't be unable to connect, because AppMaster can't redirect to the right address.
[ https://issues.apache.org/jira/browse/YARN-10775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhengchenyu updated YARN-10775:
-------------------------------
Description:
I setup a yarn federation cluster, I can't connect the running app web, but the completed app's web works.
By some debug info, I found the reason. Because AmIpFilter.PROXY_HOSTS is set by configuration (do it in AmFilterInitializer.getProxyHostsAndPortsForAmFilter). In client configuration, there are no configuation about 'rm web port', so the url can't not be redirect.
I think client should not know rm's web port, especially in yarn federation mode.
Note:
Here is my specially configuration for client. I use ha for select router randomly.
||config||value||
|yarn.resourcemanager.ha.enabled|true|
|yarn.resourcemanager.ha.rm-ids|r1|
|yarn.resourcemanager.address.r1|router_host:8050|
|yarn.resourcemanager.scheduler.address.r1|localhost:8049|
was:
I setup a yarn federation cluster, I can't connect the running app web, but the completed app's web works.
By some debug info, I found the reason. Because AmIpFilter.PROXY_HOSTS is set by configuration (do it in AmFilterInitializer.getProxyHostsAndPortsForAmFilter). In client configuration, there are no configuation about 'rm web port', so the url can't not be redirect.
I think client should not know rm's web port, especially in yarn federation mode.
Note:
Here is my specially configuration for client. I use ha for select router randomly.
|| config || value ||
| yarn.resourcemanager.ha.enabled | true |
| yarn.resourcemanager.ha.rm-ids | r1 |
|yarn.resourcemanager.address.r1 | router_host:8050 |
|yarn.resourcemanager.scheduler.address.r1 | localhost:8049 |
> Federation: Yarn running app web can't be unable to connect, because AppMaster can't redirect to the right address.
> --------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-10775
> URL: https://issues.apache.org/jira/browse/YARN-10775
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: zhengchenyu
> Assignee: zhengchenyu
> Priority: Major
>
> I setup a yarn federation cluster, I can't connect the running app web, but the completed app's web works.
> By some debug info, I found the reason. Because AmIpFilter.PROXY_HOSTS is set by configuration (do it in AmFilterInitializer.getProxyHostsAndPortsForAmFilter). In client configuration, there are no configuation about 'rm web port', so the url can't not be redirect.
> I think client should not know rm's web port, especially in yarn federation mode.
> Note:
> Here is my specially configuration for client. I use ha for select router randomly.
> ||config||value||
> |yarn.resourcemanager.ha.enabled|true|
> |yarn.resourcemanager.ha.rm-ids|r1|
> |yarn.resourcemanager.address.r1|router_host:8050|
> |yarn.resourcemanager.scheduler.address.r1|localhost:8049|
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org