You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by Hansi Klose <ha...@web.de> on 2014/09/05 10:31:52 UTC

CDH5 MRV1 HA / YARN HA port assignment

Hi,

I am playing with CDH5 jobtracker HA and YARN HA configuration.

I am wondering about the configuration example in their web site. 
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-High-Availability-Guide/cdh5hag_jt_ha_config.html

They uses for each service on different nodes different ports.

Like 

mapred.jobtracker.rpc-address.logicaljt.jt1 = myjt1.myco.com:8021
mapred.jobtracker.rpc-address.logicaljt.jt2 = myjt2.myco.com:8022

mapred.job.tracker.http.address.logicaljt.jt1 = 0.0.0.0:50030
mapred.job.tracker.http.address.logicaljt.jt2 = 0.0.0.0:50031

mapred.ha.jobtracker.rpc-address.logicaljt.jt1 = myjt1.myco.com:8023
mapred.ha.jobtracker.rpc-address.logicaljt.jt2 = myjt2.myco.com:8024

mapred.ha.jobtracker.http-redirect-address.logicaljt.jt1 = myjt1.myco.com:50030
mapred.ha.jobtracker.http-redirect-address.logicaljt.jt2 = myjt2.myco.com:50031

Why do I need different ports when i use different nodes?


On their web site about YARN HA they write
>> "In an HA setting, you should configure two RMs to use different ports (for example, ports on different hosts)."

But in the example they use the same ports for the 2 ressource managers.

So do I need to use different ports on different nodes?

Regards Hansi