You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Jing Tie <ti...@gmail.com> on 2010/09/18 02:19:09 UTC

jobtracker: Cannot assign requested address

Dear all,

I am having this exception when starting jobtracker, and I checked by
netstat that the port is not in use before running. Could you please
point out where might be the problem? Many thanks in advance!

2010-09-17 17:07:22,863 FATAL org.apache.hadoop.mapred.JobTracker:
java.net.BindException: Problem binding to hostname/ipaddress:45365 :
Cannot assign requested address
	at org.apache.hadoop.ipc.Server.bind(Server.java:190)
	at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:253)
	at org.apache.hadoop.ipc.Server.<init>(Server.java:1026)
	at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:488)
	at org.apache.hadoop.ipc.RPC.getServer(RPC.java:450)
	at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1595)
	at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
	at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
	at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)
Caused by: java.net.BindException: Cannot assign requested address
	at sun.nio.ch.Net.bind(Native Method)
	at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
	at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
	at org.apache.hadoop.ipc.Server.bind(Server.java:188)
	... 8 more


Configure in mapred-site.xml:
<property>
    <name>mapred.job.tracker</name>
    <value>hostname:45365</value>
</property>


Best,
Jing

Re: jobtracker: Cannot assign requested address

Posted by Adarsh Sharma <ad...@orkash.com>.
I am not sure but try 2 things :
1. Just give your proper Ipaddress in value
e, g 123.154.0.122:9001
2. Change the port to 9001 and your etc/hosts file must have these 
values of master and slaves
 123.154.0.122      hostname        
 123.154.0.111     hostname
 123.154.0.112     hostname


David Rosenstrauch wrote:
> On 09/21/2010 03:17 AM, Jing Tie wrote:
>> I am still suffering from the problem... Did anyone encounter it
>> before? Or any suggestions?
>>
>> Many thanks in advance!
>>
>> Jing
>>
>> On Fri, Sep 17, 2010 at 5:19 PM, Jing Tie<ti...@gmail.com>  wrote:
>>> Dear all,
>>>
>>> I am having this exception when starting jobtracker, and I checked by
>>> netstat that the port is not in use before running. Could you please
>>> point out where might be the problem? Many thanks in advance!
>>>
>>> 2010-09-17 17:07:22,863 FATAL org.apache.hadoop.mapred.JobTracker:
>>> java.net.BindException: Problem binding to hostname/ipaddress:45365 :
>>> Cannot assign requested address
>
>>> Configure in mapred-site.xml:
>>> <property>
>>>     <name>mapred.job.tracker</name>
>>>     <value>hostname:45365</value>
>>> </property>
>>>
>>>
>>> Best,
>>> Jing
>
> Some suggestions:
>
> 1) try:
> <property>
>     <name>mapred.job.tracker</name>
>     <value>hdfs://hostname:45365</value>
> </property>
>
> 2) Is the port correct?
>
> 3) Is the hostname correct?
>
> 4) Have you verfified that the host is definitely listening on that 
> port?  (e.g., netstat -nap | grep LISTEN)
>
> HTH,
>
> DR


Re: jobtracker: Cannot assign requested address

Posted by David Rosenstrauch <da...@darose.net>.
On 09/21/2010 03:17 AM, Jing Tie wrote:
> I am still suffering from the problem... Did anyone encounter it
> before? Or any suggestions?
>
> Many thanks in advance!
>
> Jing
>
> On Fri, Sep 17, 2010 at 5:19 PM, Jing Tie<ti...@gmail.com>  wrote:
>> Dear all,
>>
>> I am having this exception when starting jobtracker, and I checked by
>> netstat that the port is not in use before running. Could you please
>> point out where might be the problem? Many thanks in advance!
>>
>> 2010-09-17 17:07:22,863 FATAL org.apache.hadoop.mapred.JobTracker:
>> java.net.BindException: Problem binding to hostname/ipaddress:45365 :
>> Cannot assign requested address

>> Configure in mapred-site.xml:
>> <property>
>>     <name>mapred.job.tracker</name>
>>     <value>hostname:45365</value>
>> </property>
>>
>>
>> Best,
>> Jing

Some suggestions:

1) try:
<property>
     <name>mapred.job.tracker</name>
     <value>hdfs://hostname:45365</value>
</property>

2) Is the port correct?

3) Is the hostname correct?

4) Have you verfified that the host is definitely listening on that 
port?  (e.g., netstat -nap | grep LISTEN)

HTH,

DR

JobTracker - Cannot assign requested address

Posted by modemide <mo...@gmail.com>.
Problem:
After adding another PC to use as a stand-alone JobTracker, I get the
"cannot assign requested address" error in the JobTracker log on the master
when running bin/start-all.sh

If I run the following on the new JobTracker machine:
bin/start-mapred.sh

Everything works great, except that also starts a task tracker instance and
the JobTracker machine participates in reduces instead of just managing
jobs.

Did I misconfigure something?  How do I prevent the JobTracker from running
a TaskTracker from starting.  Similarly, how do I fix the issue with the
master failing to spawn a JobTracker instance on the new machine?

Note:
Also, I do realize that having a job tracker at this point is overkill,
however, I'm just trying to emulate a working environment.  My setup worked
perfectly when I just had 4 TaskTrackers, and 1 NameNode (also running
JobTracker).  




My setup:
4 TaskTracker / DateNodes
10.1.10.9
10.1.10.10
10.1.10.17
10.1.10.18

1 NameNode
10.1.10.1

1 JobTracker
10.1.10.2


Config:
NameNode/mapred-site.xml:
DataNodes/mapred-site.xml:


mapred.job.tracker
JOBTRACKER:54311




JobTracker/mapred-site.xml:


mapred.job.tracker
JOBTRACKER:54311



mapred.map.tasks
40



mapred.reduce.tasks
8




Details:
When I run bin/start-all.sh from the master, my thought would have been that
the Master would start everything in this order:
Master starts - NameNode @ Master
Master starts - 4 DataNodes
Master starts - SecondaryNameNode @ Master
Master starts - JobTracker @ new Job Tracker machine <----***********
Master starts - 4 TaskTrackers.

However, what's actually happening is:
Master starts - NameNode @ Master
Master starts - 4 DataNodes
Master starts - SecondaryNameNode @ Master
Master tries to start JobTracker locally (it doesn't have a hostname
preceding the command, thus my assumption that its starting it locally)
<----***********
Master starts - 4 TaskTrackers.

I can't figure out why in the world it didn't start the JobTracker on the
new machine.  

--
View this message in context: http://hadoop-common.472056.n3.nabble.com/jobtracker-Cannot-assign-requested-address-tp1518660p2694562.html
Sent from the Users mailing list archive at Nabble.com.

Re: jobtracker: Cannot assign requested address

Posted by Steve Loughran <st...@apache.org>.
On 21/09/10 08:17, Jing Tie wrote:
> I am still suffering from the problem... Did anyone encounter it
> before? Or any suggestions?

Have you considered configuring the JT with a hostname other than 
"hostname", but instead with what the real machine's name is?

>
> Many thanks in advance!
>
> Jing
>
> On Fri, Sep 17, 2010 at 5:19 PM, Jing Tie<ti...@gmail.com>  wrote:
>> Dear all,
>>
>> I am having this exception when starting jobtracker, and I checked by
>> netstat that the port is not in use before running. Could you please
>> point out where might be the problem? Many thanks in advance!
>>
>> 2010-09-17 17:07:22,863 FATAL org.apache.hadoop.mapred.JobTracker:
>> java.net.BindException: Problem binding to hostname/ipaddress:45365 :
>> Cannot assign requested address
>>         at org.apache.hadoop.ipc.Server.bind(Server.java:190)
>>         at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:253)
>>         at org.apache.hadoop.ipc.Server.<init>(Server.java:1026)
>>         at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:488)
>>         at org.apache.hadoop.ipc.RPC.getServer(RPC.java:450)
>>         at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1595)
>>         at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
>>         at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
>>         at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)
>> Caused by: java.net.BindException: Cannot assign requested address
>>         at sun.nio.ch.Net.bind(Native Method)
>>         at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
>>         at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
>>         at org.apache.hadoop.ipc.Server.bind(Server.java:188)
>>         ... 8 more
>>
>>
>> Configure in mapred-site.xml:
>> <property>
>>     <name>mapred.job.tracker</name>
>>     <value>hostname:45365</value>
>> </property>
>>
>>
>> Best,
>> Jing
>>


Re: jobtracker: Cannot assign requested address

Posted by Jing Tie <ti...@gmail.com>.
I am still suffering from the problem... Did anyone encounter it
before? Or any suggestions?

Many thanks in advance!

Jing

On Fri, Sep 17, 2010 at 5:19 PM, Jing Tie <ti...@gmail.com> wrote:
> Dear all,
>
> I am having this exception when starting jobtracker, and I checked by
> netstat that the port is not in use before running. Could you please
> point out where might be the problem? Many thanks in advance!
>
> 2010-09-17 17:07:22,863 FATAL org.apache.hadoop.mapred.JobTracker:
> java.net.BindException: Problem binding to hostname/ipaddress:45365 :
> Cannot assign requested address
>        at org.apache.hadoop.ipc.Server.bind(Server.java:190)
>        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:253)
>        at org.apache.hadoop.ipc.Server.<init>(Server.java:1026)
>        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:488)
>        at org.apache.hadoop.ipc.RPC.getServer(RPC.java:450)
>        at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1595)
>        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
>        at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
>        at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)
> Caused by: java.net.BindException: Cannot assign requested address
>        at sun.nio.ch.Net.bind(Native Method)
>        at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
>        at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
>        at org.apache.hadoop.ipc.Server.bind(Server.java:188)
>        ... 8 more
>
>
> Configure in mapred-site.xml:
> <property>
>    <name>mapred.job.tracker</name>
>    <value>hostname:45365</value>
> </property>
>
>
> Best,
> Jing
>