You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/03/22 08:56:53 UTC
[GitHub] [incubator-dolphinscheduler] didiaode18 commented on issue #5026: [Improvement][common]When I run a spark task, the webui observation in yarn is successful, but the response result in dolphinscheduler fails.
didiaode18 commented on issue #5026:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/5026#issuecomment-803886064
@chengshiwen
This is my common.properties,spark task is success, And dolphinschedule can show success.
# if resourcemanager HA enable, please type the HA ips ; if resourcemanager is single, make this value empty
yarn.resourcemanager.ha.rm.ids=10.172.xx.x,10.172.3xx.x
# if resourcemanager HA enable or not use resourcemanager, please keep the default value; If resourcemanager is single, you only need to replace ds1 to actual resourcemanager hostname.
yarn.application.status.address=http://yarnIp1:23188/ws/v1/cluster/apps/%s
resource.manager.httpaddress.port=23188
Because of our company's configuration resource.manager.httpaddress.port is 23188 NOT 8088。
So I found by reading the source code ,our default common.properties No configuration resource.manager.httpaddress.port
And yarn.application.status.address's port is default 8088.So if our yarn.application.status.address's port is not 8088,
We must modify yarn.application.status.address and resource.manager.httpaddress.port,dolphinschedule can show success.
Finally, We can extract these two resource ports into one ,I can solve this issue .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org