You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/03/22 08:56:53 UTC

[GitHub] [incubator-dolphinscheduler] didiaode18 commented on issue #5026: [Improvement][common]When I run a spark task, the webui observation in yarn is successful, but the response result in dolphinscheduler fails.

didiaode18 commented on issue #5026:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/5026#issuecomment-803886064


   @chengshiwen
   This is my  common.properties,spark task is success, And  dolphinschedule can show success.
   # if resourcemanager HA enable, please type the HA ips ; if resourcemanager is single, make this value empty
   yarn.resourcemanager.ha.rm.ids=10.172.xx.x,10.172.3xx.x
   
   # if resourcemanager HA enable or not use resourcemanager, please keep the default value; If resourcemanager is single, you only need to replace ds1 to actual resourcemanager hostname.
   yarn.application.status.address=http://yarnIp1:23188/ws/v1/cluster/apps/%s
   resource.manager.httpaddress.port=23188
   
       Because of our company's configuration resource.manager.httpaddress.port is 23188 NOT 8088。
       So I found by reading the source code  ,our default common.properties No configuration resource.manager.httpaddress.port
   And yarn.application.status.address's port is default 8088.So if our yarn.application.status.address's port is not 8088,
   We must modify  yarn.application.status.address and resource.manager.httpaddress.port,dolphinschedule can show success.
      Finally, We can extract these two resource ports into one ,I can solve this issue .
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org