You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-user@hadoop.apache.org by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com> on 2012/08/08 03:45:05 UTC

Hadoop Pi map-reduce job hangs

Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7535.867BA8E0]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Thanks Devaraj. I think now I found the problem.

2003-10-28 17:15:39,718 WARN org.apache.hadoop.mapred.ReduceTask: java.net.UnknownHostException: ie22dt4yjkc1s

I will add this machine name in /etc/hosts file and see.

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 11:22 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs("/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs
Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD755E.45719660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Thanks Devaraj. I think now I found the problem.

2003-10-28 17:15:39,718 WARN org.apache.hadoop.mapred.ReduceTask: java.net.UnknownHostException: ie22dt4yjkc1s

I will add this machine name in /etc/hosts file and see.

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 11:22 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs("/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs
Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD755E.45719660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Thanks Devaraj. I think now I found the problem.

2003-10-28 17:15:39,718 WARN org.apache.hadoop.mapred.ReduceTask: java.net.UnknownHostException: ie22dt4yjkc1s

I will add this machine name in /etc/hosts file and see.

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 11:22 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs("/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs
Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD755E.45719660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Thanks Devaraj. I think now I found the problem.

2003-10-28 17:15:39,718 WARN org.apache.hadoop.mapred.ReduceTask: java.net.UnknownHostException: ie22dt4yjkc1s

I will add this machine name in /etc/hosts file and see.

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 11:22 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs("/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs
Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD755E.45719660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs(“/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in “/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0” folder?. I don’t see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs(“/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in “/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0” folder?. I don’t see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs(“/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in “/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0” folder?. I don’t see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

The location whatever you are looking is correct for map tasks. There might not be any exceptions in the map phase since it is completed 100%. It seems to be some problem in the reduce phase.



Can you check what is happening in the running reducer tasks logs(“/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/%Reduce-Task-ID%). Running reducer task ids can be found from from the Job Tracker UI.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 11:02 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in “/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0” folder?. I don’t see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by "Chandra Mohan, Ananda Vel Murugan" <An...@honeywell.com>.

Hi Devaraj,

Thanks for the response.

Do you mean the logs available in "/var/hadoop/tmp/mapred/local/userlogs/job_201208081600_0001/attempt_201208081600_0001_m_000005_0" folder?. I don't see any log in stderr file.  Also syslog file has no exception or error.

Am I looking at correct file?

Regards,
Anand.C

________________________________
From: Devaraj k [mailto:devaraj.k@huawei.com]
Sent: Wednesday, August 08, 2012 10:45 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop Pi map-reduce job hangs


Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs
Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7555.4ADC1660]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs

Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7535.867BA8E0]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs

Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7535.867BA8E0]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs

Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7535.867BA8E0]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C

RE: Hadoop Pi map-reduce job hangs

Posted by Devaraj k <de...@huawei.com>.

Hi Anand,



   Can you check the task attempt logs for job, what is happening in the reduce task.





Thanks

Devaraj

________________________________
From: Chandra Mohan, Ananda Vel Murugan [Ananda.Murugan@honeywell.com]
Sent: Wednesday, August 08, 2012 7:15 AM
To: user@hadoop.apache.org
Subject: Hadoop Pi map-reduce job hangs

Hi,

I have set up a three node cluster following the instructions here

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-multi-node-cluster/

I ran into java.io.IOException: Incompatible namespaceIDs error and I fixed by manually updating the namespace ID. I restarted the cluster and tried running sample Pi calculation job. It hangs as shown below

[cid:image001.jpg@01CD7535.867BA8E0]

It is running for more than 30 minutes. I quickly checked the logs and did not find any exception. How do I fix this? Any help would be greatly appreciated.

Regards,
Anand.C