You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by 马福辰 <fu...@gmail.com> on 2023/05/05 02:11:02 UTC

Hadoop execution failure

I found a bug when executing the hadoop in namenode, the version is 3.3.2.
The namenode throws the following trace:
```
2023-03-27 17:35:23,759 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
for port 9000: readAndProcess from client 192.168.101.162:56078 threw
exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at
java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
        at
java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
        at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
2023-03-27 17:35:24,271 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
for port 9000: readAndProcess from client 192.168.101.162:56084 threw
exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at
java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
        at
java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
        at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
```

Re: Hadoop execution failure

Posted by Ayush Saxena <ay...@gmail.com>.
What is the bug here? Connection reset by peer, mostly n/w issue or the client
aborted the connection.

  

What were you executing? Is this intermittent? What is the state of the task
that you ran? Is it happening for all operations or few?

  

Mostly this ain’t a bug but some issue with your cluster

  

-Ayush  
  

Sent from my iPhone

  

> On 05-May-2023, at 7:42 AM, 马福辰 <fu...@gmail.com> wrote:  
>  
>

> 
>
> I found a bug when executing the hadoop in namenode, the version is 3.3.2.
> The namenode throws the following trace:
>
> ```
>
> 2023-03-27 17:35:23,759 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
> for port 9000: readAndProcess from client
> [192.168.101.162:56078](http://192.168.101.162:56078) threw exception
> [java.io.IOException: Connection reset by peer]  
> java.io.IOException: Connection reset by peer  
>         at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)  
>         at
> java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)  
>         at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)  
>         at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)  
>         at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)  
>         at
> java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)  
>         at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)  
>         at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)  
>         at
> org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)  
>         at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)  
>         at
> org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)  
>         at
> org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)  
> 2023-03-27 17:35:24,271 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
> for port 9000: readAndProcess from client
> [192.168.101.162:56084](http://192.168.101.162:56084) threw exception
> [java.io.IOException: Connection reset by peer]  
> java.io.IOException: Connection reset by peer  
>         at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)  
>         at
> java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)  
>         at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)  
>         at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)  
>         at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)  
>         at
> java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)  
>         at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)  
>         at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)  
>         at
> org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)  
>         at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)  
>         at
> org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)  
>         at
> org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)  
>
>
> ```  
>

Fwd: Hadoop execution failure

Posted by 马福辰 <fu...@gmail.com>.
---------- Forwarded message ---------
发件人： 马福辰 <fu...@gmail.com>
Date: 2023年5月5日周五 10:11
Subject: Hadoop execution failure
To: <us...@hadoop.apache.org>


I found a bug when executing the hadoop in namenode, the version is 3.3.2.
The namenode throws the following trace:
```
2023-03-27 17:35:23,759 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
for port 9000: readAndProcess from client 192.168.101.162:56078 threw
exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at
java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
        at
java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
        at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
2023-03-27 17:35:24,271 INFO org.apache.hadoop.ipc.Server: Socket Reader #1
for port 9000: readAndProcess from client 192.168.101.162:56084 threw
exception [java.io.IOException: Connection reset by peer]
java.io.IOException: Connection reset by peer
        at java.base/sun.nio.ch.FileDispatcherImpl.read0(Native Method)
        at
java.base/sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
        at java.base/sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:245)
        at java.base/sun.nio.ch.IOUtil.read(IOUtil.java:223)
        at
java.base/sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:370)
        at org.apache.hadoop.ipc.Server.channelRead(Server.java:3639)
        at org.apache.hadoop.ipc.Server.access$2600(Server.java:144)
        at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:2262)
        at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:1449)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:1304)
        at
org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:1275)
```