You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by "Hiller, Dean (Contractor)" <de...@broadridge.com> on 2011/01/04 21:56:10 UTC

where are the hadoop logs for this...

I am seeing this log on the screen when running from my client (hadoop
-copyFromLocal)

 

11/01/04 06:49:24 INFO hdfs.DFSClient: Exception in
createBlockOutputStream java

.net.ConnectException: Connection refused

 

I can't find where the logs are for this hadoop client process run to
see what machine it is having trouble connecting to so I can run the
standard debugging to see why that port is not available on that
machine, but I don't know which port or which machine it's trying to
reach.  Any idea where those lots are?

 

Also, if developers could add a try{}catch(ConnectionRefused) rethrow
new ConnectionRefused("Connection to <machine> <port> refused", e), that
would rock so it would have just shown up in my hadoop client's log
file.

 

Anyways, any ideas,

Thanks,

Dean


This message and any attachments are intended only for the use of the addressee and
may contain information that is privileged and confidential. If the reader of the 
message is not the intended recipient or an authorized representative of the
intended recipient, you are hereby notified that any dissemination of this
communication is strictly prohibited. If you have received this communication in
error, please notify us immediately by e-mail and delete the message and any
attachments from your system.


RE: where are the hadoop logs for this...

Posted by "Hiller, Dean (Contractor)" <de...@broadridge.com>.
Afraid not.  (that was the first thing I tried)  My only grep of
Connection is  (guess I have to go into debug mode and fiddle around
there).

 

[root@DNVR-DEV3 logs]# grep "Connection" *

hadoop-root-namenode-DNVR-DEV3.log:2011-01-04 02:30:58,180 INFO
org.apache.hadoo

p.ipc.Server: IPC Server listener on 54310: readAndProcess threw
exception java.

io.IOException: Connection reset by peer. Count of bytes read: 0

hadoop-root-namenode-DNVR-DEV3.log:java.io.IOException: Connection reset
by peer

 

hadoop-root-namenode-DNVR-DEV3.log:     at
org.apache.hadoop.ipc.Server$Connecti

on.readAndProcess(Server.java:799)

hadoop-root-namenode-DNVR-DEV3.log:2011-01-04 09:20:42,240 INFO
org.apache.hadoo

p.ipc.Server: IPC Server listener on 54310: readAndProcess threw
exception java.

io.IOException: Connection reset by peer. Count of bytes read: 0

hadoop-root-namenode-DNVR-DEV3.log:java.io.IOException: Connection reset
by peer

 

hadoop-root-namenode-DNVR-DEV3.log:     at
org.apache.hadoop.ipc.Server$Connecti

on.readAndProcess(Server.java:799)

[root@DNVR-DEV3 logs]#

 

From: Ravi Phulari [mailto:iphulari@gmail.com] 
Sent: Tuesday, January 04, 2011 3:17 PM
To: hdfs-user@hadoop.apache.org
Subject: Re: where are the hadoop logs for this...

 

You can get these logs in Name node logs.

 

--

Ravi

On Tue, Jan 4, 2011 at 12:56 PM, Hiller, Dean (Contractor)
<de...@broadridge.com> wrote:

I am seeing this log on the screen when running from my client (hadoop
-copyFromLocal)

 

11/01/04 06:49:24 INFO hdfs.DFSClient: Exception in
createBlockOutputStream java

.net.ConnectException: Connection refused

 

I can't find where the logs are for this hadoop client process run to
see what machine it is having trouble connecting to so I can run the
standard debugging to see why that port is not available on that
machine, but I don't know which port or which machine it's trying to
reach.  Any idea where those lots are?

 

Also, if developers could add a try{}catch(ConnectionRefused) rethrow
new ConnectionRefused("Connection to <machine> <port> refused", e), that
would rock so it would have just shown up in my hadoop client's log
file.

 

Anyways, any ideas,

Thanks,

Dean

This message and any attachments are intended only for the use of the
addressee and
may contain information that is privileged and confidential. If the
reader of the 
message is not the intended recipient or an authorized representative of
the
intended recipient, you are hereby notified that any dissemination of
this
communication is strictly prohibited. If you have received this
communication in
error, please notify us immediately by e-mail and delete the message and
any
attachments from your system.
 

 


This message and any attachments are intended only for the use of the addressee and
may contain information that is privileged and confidential. If the reader of the 
message is not the intended recipient or an authorized representative of the
intended recipient, you are hereby notified that any dissemination of this
communication is strictly prohibited. If you have received this communication in
error, please notify us immediately by e-mail and delete the message and any
attachments from your system.


Re: where are the hadoop logs for this...

Posted by Ravi Phulari <ip...@gmail.com>.
You can get these logs in Name node logs.

--
Ravi

On Tue, Jan 4, 2011 at 12:56 PM, Hiller, Dean (Contractor) <
dean.hiller@broadridge.com> wrote:

> I am seeing this log on the screen when running from my client (hadoop
> –copyFromLocal)
>
>
>
> 11/01/04 06:49:24 INFO hdfs.DFSClient: Exception in createBlockOutputStream
> java
>
> .net.ConnectException: Connection refused
>
>
>
> I can’t find where the logs are for this hadoop client process run to see
> what machine it is having trouble connecting to so I can run the standard
> debugging to see why that port is not available on that machine, but I don’t
> know which port or which machine it’s trying to reach.  Any idea where those
> lots are?
>
>
>
> Also, if developers could add a try{}catch(ConnectionRefused) rethrow new
> ConnectionRefused(“Connection to <machine> <port> refused”, e), that would
> rock so it would have just shown up in my hadoop client’s log file.
>
>
>
> Anyways, any ideas,
>
> Thanks,
>
> Dean
>
> This message and any attachments are intended only for the use of the addressee and
> may contain information that is privileged and confidential. If the reader of the
> message is not the intended recipient or an authorized representative of the
> intended recipient, you are hereby notified that any dissemination of this
> communication is strictly prohibited. If you have received this communication in
> error, please notify us immediately by e-mail and delete the message and any
> attachments from your system.
>
>
>