You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by xeonmailinglist-gmail <xe...@gmail.com> on 2015/05/14 12:16:01 UTC
Configure ResourceManager to accept remote jobs
Hi,
I have an host |HostA| that has a public and a private IP address [1]. I
want to configure Yarn MapReduce so that it is possible to submit jobs
remotely.
I have put the public IP in the yarn-site.xml [2], but still can’t
launch the resource manager [3]. How can I enable MapReduce to accept
remote jobs submission?
[1]
|Hostname: HostA
Public IP: 205.172.170.25
Private IP: 172.16.100.1
|
[2]
|<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>205.172.170.25:8025</value> </property>
<property> <name>yarn.resourcemanager.scheduler.address</name> <value>205.172.170.25:8030</value> </property>
<property> <name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value> </property>
<!-- job history -->
<property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property>
<property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value> </property>
<property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value> </property>
<!-- proxy -->
<property><name>yarn.web-proxy.address</name><value>205.172.170.25:9046</value></property>
</configuration>
|
[4]
|org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [205.172.170.25:8025] java.net.BindException: Cannot assign requested a
ddress; For more details see:http://wiki.apache.org/hadoop/BindException
|
—
Thanks,
--
--
Re: Configure ResourceManager to accept remote jobs
Posted by Jian He <jh...@hortonworks.com>.
You are probably specifying a wrong port:
The address is configured to “8040”:
“<name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value>”
But exception messages says port “8025” :
“Problem binding to [205.172.170.25:8025] java.net.BindException:”
Jian
On May 14, 2015, at 3:16 AM, xeonmailinglist-gmail <xe...@gmail.com>> wrote:
Hi,
I have an host HostA that has a public and a private IP address [1]. I want to configure Yarn MapReduce so that it is possible to submit jobs remotely.
I have put the public IP in the yarn-site.xml [2], but still can’t launch the resource manager [3]. How can I enable MapReduce to accept remote jobs submission?
[1]
Hostname: HostA
Public IP: 205.172.170.25
Private IP: 172.16.100.1
[2]
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>205.172.170.25:8025</value> </property>
<property> <name>yarn.resourcemanager.scheduler.address</name> <value>205.172.170.25:8030</value> </property>
<property> <name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value> </property>
<!-- job history -->
<property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property>
<property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value> </property>
<property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value> </property>
<!-- proxy -->
<property><name>yarn.web-proxy.address</name><value>205.172.170.25:9046</value></property>
</configuration>
[4]
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [205.172.170.25:8025] java.net.BindException: Cannot assign requested a
ddress; For more details see: http://wiki.apache.org/hadoop/BindException
—
Thanks,
--
--
Re: Configure ResourceManager to accept remote jobs
Posted by Jian He <jh...@hortonworks.com>.
You are probably specifying a wrong port:
The address is configured to “8040”:
“<name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value>”
But exception messages says port “8025” :
“Problem binding to [205.172.170.25:8025] java.net.BindException:”
Jian
On May 14, 2015, at 3:16 AM, xeonmailinglist-gmail <xe...@gmail.com>> wrote:
Hi,
I have an host HostA that has a public and a private IP address [1]. I want to configure Yarn MapReduce so that it is possible to submit jobs remotely.
I have put the public IP in the yarn-site.xml [2], but still can’t launch the resource manager [3]. How can I enable MapReduce to accept remote jobs submission?
[1]
Hostname: HostA
Public IP: 205.172.170.25
Private IP: 172.16.100.1
[2]
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>205.172.170.25:8025</value> </property>
<property> <name>yarn.resourcemanager.scheduler.address</name> <value>205.172.170.25:8030</value> </property>
<property> <name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value> </property>
<!-- job history -->
<property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property>
<property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value> </property>
<property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value> </property>
<!-- proxy -->
<property><name>yarn.web-proxy.address</name><value>205.172.170.25:9046</value></property>
</configuration>
[4]
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [205.172.170.25:8025] java.net.BindException: Cannot assign requested a
ddress; For more details see: http://wiki.apache.org/hadoop/BindException
—
Thanks,
--
--
Re: Configure ResourceManager to accept remote jobs
Posted by Jian He <jh...@hortonworks.com>.
You are probably specifying a wrong port:
The address is configured to “8040”:
“<name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value>”
But exception messages says port “8025” :
“Problem binding to [205.172.170.25:8025] java.net.BindException:”
Jian
On May 14, 2015, at 3:16 AM, xeonmailinglist-gmail <xe...@gmail.com>> wrote:
Hi,
I have an host HostA that has a public and a private IP address [1]. I want to configure Yarn MapReduce so that it is possible to submit jobs remotely.
I have put the public IP in the yarn-site.xml [2], but still can’t launch the resource manager [3]. How can I enable MapReduce to accept remote jobs submission?
[1]
Hostname: HostA
Public IP: 205.172.170.25
Private IP: 172.16.100.1
[2]
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>205.172.170.25:8025</value> </property>
<property> <name>yarn.resourcemanager.scheduler.address</name> <value>205.172.170.25:8030</value> </property>
<property> <name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value> </property>
<!-- job history -->
<property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property>
<property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value> </property>
<property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value> </property>
<!-- proxy -->
<property><name>yarn.web-proxy.address</name><value>205.172.170.25:9046</value></property>
</configuration>
[4]
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [205.172.170.25:8025] java.net.BindException: Cannot assign requested a
ddress; For more details see: http://wiki.apache.org/hadoop/BindException
—
Thanks,
--
--
Re: Configure ResourceManager to accept remote jobs
Posted by Jian He <jh...@hortonworks.com>.
You are probably specifying a wrong port:
The address is configured to “8040”:
“<name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value>”
But exception messages says port “8025” :
“Problem binding to [205.172.170.25:8025] java.net.BindException:”
Jian
On May 14, 2015, at 3:16 AM, xeonmailinglist-gmail <xe...@gmail.com>> wrote:
Hi,
I have an host HostA that has a public and a private IP address [1]. I want to configure Yarn MapReduce so that it is possible to submit jobs remotely.
I have put the public IP in the yarn-site.xml [2], but still can’t launch the resource manager [3]. How can I enable MapReduce to accept remote jobs submission?
[1]
Hostname: HostA
Public IP: 205.172.170.25
Private IP: 172.16.100.1
[2]
<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property> <name>yarn.resourcemanager.resource-tracker.address</name> <value>205.172.170.25:8025</value> </property>
<property> <name>yarn.resourcemanager.scheduler.address</name> <value>205.172.170.25:8030</value> </property>
<property> <name>yarn.resourcemanager.address</name> <value>205.172.170.25:8040</value> </property>
<!-- job history -->
<property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property>
<property> <name>yarn.nodemanager.log.retain-seconds</name> <value>900000</value> </property>
<property> <name>yarn.nodemanager.remote-app-log-dir</name> <value>/app-logs</value> </property>
<!-- proxy -->
<property><name>yarn.web-proxy.address</name><value>205.172.170.25:9046</value></property>
</configuration>
[4]
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: java.net.BindException: Problem binding to [205.172.170.25:8025] java.net.BindException: Cannot assign requested a
ddress; For more details see: http://wiki.apache.org/hadoop/BindException
—
Thanks,
--
--