You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@cassandra.apache.org by Anty <an...@gmail.com> on 2010/04/03 15:56:27 UTC
Re: 0.5.1 exception: java.io.IOException: Reached an EOL or something
bizzare occured
Does anyone have solve the problem?I encounter the same error too.
On Mon, Mar 29, 2010 at 12:12 AM, Benoit Perroud <be...@noisette.ch> wrote:
> I got the same error when the nodes are using lot of I/O, i.e during
> compaction.
>
> 2010/3/28 Eric Yu <su...@gmail.com>:
> > I have not restart my nodes.
> > OK, may be I should give 0.6 a try.
> >
> > On Sun, Mar 28, 2010 at 9:53 AM, Jonathan Ellis <jb...@gmail.com>
> wrote:
> >>
> >> It means that a MessagingService socket closed unexpectedly. If
> >> you're starting and restarting nodes that could cause it.
> >>
> >> This code is obsolete in 0.6 anyway.
> >>
> >> On Sat, Mar 27, 2010 at 8:51 PM, Eric Yu <su...@gmail.com> wrote:
> >> > And one more clue here, when ReplicateFactor is 1, it's OK, after
> >> > changed to
> >> > 2, the exception occurred.
> >> >
> >> > On Sun, Mar 28, 2010 at 9:46 AM, Eric Yu <su...@gmail.com> wrote:
> >> >>
> >> >> Hi Jonathan,
> >> >>
> >> >> I upgraded my jdk to latest version, and I am sure I start Cassandra
> >> >> with
> >> >> it (set JAVA_HOME in cassansra.in.sh).
> >> >> But the exception still there, any idea?
> >> >>
> >> >> On Sun, Mar 28, 2010 at 12:02 AM, Jonathan Ellis <jb...@gmail.com>
> >> >> wrote:
> >> >>>
> >> >>> This means you need to upgrade your jdk to build 18 or later
> >> >>>
> >> >>> On Sat, Mar 27, 2010 at 10:55 AM, Eric Yu <su...@gmail.com> wrote:
> >> >>> > Hi, list
> >> >>> > I got this exception when insert into a cluster with 5 node, is
> this
> >> >>> > a
> >> >>> > bug
> >> >>> > or something else is wrong.
> >> >>> >
> >> >>> > here is the system log:
> >> >>> >
> >> >>> > INFO [GMFD:1] 2010-03-27 23:15:16,145 Gossiper.java (line 543)
> >> >>> > InetAddress
> >> >>> > /172.19.15.210 is now UP
> >> >>> > ERROR [Timer-1] 2010-03-27 23:23:27,739 TcpConnection.java (line
> >> >>> > 308)
> >> >>> > Closing down connection java.nio.channels.SocketChannel[connected
> >> >>> > local=/172.19.15.209:58261 remote=/172.19.15.210:7000] with
> 342218
> >> >>> > writes
> >> >>> > remaining.
> >> >>> > INFO [Timer-1] 2010-03-27 23:23:27,792 Gossiper.java (line 194)
> >> >>> > InetAddress
> >> >>> > /172.19.15.210 is now dead.
> >> >>> > INFO [GMFD:1] 2010-03-27 23:23:32,214 Gossiper.java (line 543)
> >> >>> > InetAddress
> >> >>> > /172.19.15.210 is now UP
> >> >>> > ERROR [Timer-1] 2010-03-27 23:24:47,846 TcpConnection.java (line
> >> >>> > 308)
> >> >>> > Closing down connection java.nio.channels.SocketChannel[connected
> >> >>> > local=/172.19.15.209:59801 remote=/172.19.15.210:7000] with
> 256285
> >> >>> > writes
> >> >>> > remaining.
> >> >>> > INFO [Timer-1] 2010-03-27 23:24:47,846 Gossiper.java (line 194)
> >> >>> > InetAddress
> >> >>> > /172.19.15.210 is now dead.
> >> >>> > WARN [MESSAGING-SERVICE-POOL:1] 2010-03-27 23:25:05,580
> >> >>> > TcpConnection.java
> >> >>> > (line 484) Problem reading from socket connected to :
> >> >>> > java.nio.channels.SocketChannel[connected local=/
> 172.19.15.209:7000
> >> >>> > remote=/172.19.15.210:55473]
> >> >>> > INFO [GMFD:1] 2010-03-27 23:25:05,580 Gossiper.java (line 543)
> >> >>> > InetAddress
> >> >>> > /172.19.15.210 is now UP
> >> >>> > WARN [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
> >> >>> > TcpConnection.java
> >> >>> > (line 484) Problem reading from socket connected to :
> >> >>> > java.nio.channels.SocketChannel[connected local=/
> 172.19.15.209:7000
> >> >>> > remote=/172.19.15.210:45504]
> >> >>> > WARN [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
> >> >>> > TcpConnection.java
> >> >>> > (line 485) Exception was generated at : 03/27/2010 23:25:05 on
> >> >>> > thread
> >> >>> > MESSAGING-SERVICE-POOL:2
> >> >>> > Reached an EOL or something bizzare occured. Reading from:
> >> >>> > /172.19.15.210
> >> >>> > BufferSizeRemaining: 16
> >> >>> > java.io.IOException: Reached an EOL or something bizzare occured.
> >> >>> > Reading
> >> >>> > from: /172.19.15.210 BufferSizeRemaining: 16
> >> >>> > at
> >> >>> > org.apache.cassandra.net.io.StartState.doRead(StartState.java:44)
> >> >>> > at
> >> >>> >
> >> >>> >
> org.apache.cassandra.net.io.ProtocolState.read(ProtocolState.java:39)
> >> >>> > at
> >> >>> > org.apache.cassandra.net.io.TcpReader.read(TcpReader.java:95)
> >> >>> > at
> >> >>> >
> >> >>> >
> >> >>> >
> org.apache.cassandra.net.TcpConnection$ReadWorkItem.run(TcpConnection.java:445)
> >> >>> > at
> >> >>> >
> >> >>> >
> >> >>> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> >> >>> > at
> >> >>> >
> >> >>> >
> >> >>> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> >> >>> > at java.lang.Thread.run(Thread.java:636)
> >> >>> >
> >> >>> > INFO [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
> >> >>> > TcpConnection.java
> >> >>> > (line 315) Closing errored connection
> >> >>> > java.nio.channels.SocketChannel[connected local=/
> 172.19.15.209:7000
> >> >>> > remote=/172.19.15.210:45504]
> >> >>> > WARN [MESSAGING-SERVICE-POOL:1] 2010-03-27 23:25:05,632
> >> >>> > TcpConnection.java
> >> >>> > (line 485) Exception was generated at : 03/27/2010 23:25:05 on
> >> >>> > thread
> >> >>> > MESSAGING-SERVICE-POOL:1
> >> >>> >
> >> >>
> >> >
> >> >
> >
> >
>
--
Best Regards
Anty Rao
Re: 0.5.1 exception: java.io.IOException: Reached an EOL or something
bizzare occured
Posted by Benoit Perroud <be...@noisette.ch>.
My guess is that the servers I use have not enough I/O nor CPU power.
I run on a virtualized env, and even the vmstat command lag a lot.
But it do not appears that the overall application behavior is
degraded by this error, only the "eventually" takes a little longer.
--
Kind regads,
Benoit.
2010/4/3 Anty <an...@gmail.com>:
> Does anyone have solve the problem?I encounter the same error too.
>
> On Mon, Mar 29, 2010 at 12:12 AM, Benoit Perroud <be...@noisette.ch> wrote:
>>
>> I got the same error when the nodes are using lot of I/O, i.e during
>> compaction.
>>
>> 2010/3/28 Eric Yu <su...@gmail.com>:
>> > I have not restart my nodes.
>> > OK, may be I should give 0.6 a try.
>> >
>> > On Sun, Mar 28, 2010 at 9:53 AM, Jonathan Ellis <jb...@gmail.com>
>> > wrote:
>> >>
>> >> It means that a MessagingService socket closed unexpectedly. If
>> >> you're starting and restarting nodes that could cause it.
>> >>
>> >> This code is obsolete in 0.6 anyway.
>> >>
>> >> On Sat, Mar 27, 2010 at 8:51 PM, Eric Yu <su...@gmail.com> wrote:
>> >> > And one more clue here, when ReplicateFactor is 1, it's OK, after
>> >> > changed to
>> >> > 2, the exception occurred.
>> >> >
>> >> > On Sun, Mar 28, 2010 at 9:46 AM, Eric Yu <su...@gmail.com> wrote:
>> >> >>
>> >> >> Hi Jonathan,
>> >> >>
>> >> >> I upgraded my jdk to latest version, and I am sure I start Cassandra
>> >> >> with
>> >> >> it (set JAVA_HOME in cassansra.in.sh).
>> >> >> But the exception still there, any idea?
>> >> >>
>> >> >> On Sun, Mar 28, 2010 at 12:02 AM, Jonathan Ellis <jb...@gmail.com>
>> >> >> wrote:
>> >> >>>
>> >> >>> This means you need to upgrade your jdk to build 18 or later
>> >> >>>
>> >> >>> On Sat, Mar 27, 2010 at 10:55 AM, Eric Yu <su...@gmail.com> wrote:
>> >> >>> > Hi, list
>> >> >>> > I got this exception when insert into a cluster with 5 node, is
>> >> >>> > this
>> >> >>> > a
>> >> >>> > bug
>> >> >>> > or something else is wrong.
>> >> >>> >
>> >> >>> > here is the system log:
>> >> >>> >
>> >> >>> > INFO [GMFD:1] 2010-03-27 23:15:16,145 Gossiper.java (line 543)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now UP
>> >> >>> > ERROR [Timer-1] 2010-03-27 23:23:27,739 TcpConnection.java (line
>> >> >>> > 308)
>> >> >>> > Closing down connection java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:58261 remote=/172.19.15.210:7000] with
>> >> >>> > 342218
>> >> >>> > writes
>> >> >>> > remaining.
>> >> >>> > INFO [Timer-1] 2010-03-27 23:23:27,792 Gossiper.java (line 194)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now dead.
>> >> >>> > INFO [GMFD:1] 2010-03-27 23:23:32,214 Gossiper.java (line 543)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now UP
>> >> >>> > ERROR [Timer-1] 2010-03-27 23:24:47,846 TcpConnection.java (line
>> >> >>> > 308)
>> >> >>> > Closing down connection java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:59801 remote=/172.19.15.210:7000] with
>> >> >>> > 256285
>> >> >>> > writes
>> >> >>> > remaining.
>> >> >>> > INFO [Timer-1] 2010-03-27 23:24:47,846 Gossiper.java (line 194)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now dead.
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:1] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 484) Problem reading from socket connected to :
>> >> >>> > java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:7000
>> >> >>> > remote=/172.19.15.210:55473]
>> >> >>> > INFO [GMFD:1] 2010-03-27 23:25:05,580 Gossiper.java (line 543)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now UP
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 484) Problem reading from socket connected to :
>> >> >>> > java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:7000
>> >> >>> > remote=/172.19.15.210:45504]
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 485) Exception was generated at : 03/27/2010 23:25:05 on
>> >> >>> > thread
>> >> >>> > MESSAGING-SERVICE-POOL:2
>> >> >>> > Reached an EOL or something bizzare occured. Reading from:
>> >> >>> > /172.19.15.210
>> >> >>> > BufferSizeRemaining: 16
>> >> >>> > java.io.IOException: Reached an EOL or something bizzare occured.
>> >> >>> > Reading
>> >> >>> > from: /172.19.15.210 BufferSizeRemaining: 16
>> >> >>> > at
>> >> >>> > org.apache.cassandra.net.io.StartState.doRead(StartState.java:44)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> > org.apache.cassandra.net.io.ProtocolState.read(ProtocolState.java:39)
>> >> >>> > at
>> >> >>> > org.apache.cassandra.net.io.TcpReader.read(TcpReader.java:95)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > org.apache.cassandra.net.TcpConnection$ReadWorkItem.run(TcpConnection.java:445)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>> >> >>> > at java.lang.Thread.run(Thread.java:636)
>> >> >>> >
>> >> >>> > INFO [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 315) Closing errored connection
>> >> >>> > java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:7000
>> >> >>> > remote=/172.19.15.210:45504]
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:1] 2010-03-27 23:25:05,632
>> >> >>> > TcpConnection.java
>> >> >>> > (line 485) Exception was generated at : 03/27/2010 23:25:05 on
>> >> >>> > thread
>> >> >>> > MESSAGING-SERVICE-POOL:1
>> >> >>> >
>> >> >>
>> >> >
>> >> >
>> >
>> >
>
>
>
> --
> Best Regards
> Anty Rao
>
Re: 0.5.1 exception: java.io.IOException: Reached an EOL or something
bizzare occured
Posted by Jonathan Ellis <jb...@gmail.com>.
Short answer: upgrade to 0.6.
On Sat, Apr 3, 2010 at 7:56 AM, Anty <an...@gmail.com> wrote:
> Does anyone have solve the problem?I encounter the same error too.
>
> On Mon, Mar 29, 2010 at 12:12 AM, Benoit Perroud <be...@noisette.ch> wrote:
>>
>> I got the same error when the nodes are using lot of I/O, i.e during
>> compaction.
>>
>> 2010/3/28 Eric Yu <su...@gmail.com>:
>> > I have not restart my nodes.
>> > OK, may be I should give 0.6 a try.
>> >
>> > On Sun, Mar 28, 2010 at 9:53 AM, Jonathan Ellis <jb...@gmail.com>
>> > wrote:
>> >>
>> >> It means that a MessagingService socket closed unexpectedly. If
>> >> you're starting and restarting nodes that could cause it.
>> >>
>> >> This code is obsolete in 0.6 anyway.
>> >>
>> >> On Sat, Mar 27, 2010 at 8:51 PM, Eric Yu <su...@gmail.com> wrote:
>> >> > And one more clue here, when ReplicateFactor is 1, it's OK, after
>> >> > changed to
>> >> > 2, the exception occurred.
>> >> >
>> >> > On Sun, Mar 28, 2010 at 9:46 AM, Eric Yu <su...@gmail.com> wrote:
>> >> >>
>> >> >> Hi Jonathan,
>> >> >>
>> >> >> I upgraded my jdk to latest version, and I am sure I start Cassandra
>> >> >> with
>> >> >> it (set JAVA_HOME in cassansra.in.sh).
>> >> >> But the exception still there, any idea?
>> >> >>
>> >> >> On Sun, Mar 28, 2010 at 12:02 AM, Jonathan Ellis <jb...@gmail.com>
>> >> >> wrote:
>> >> >>>
>> >> >>> This means you need to upgrade your jdk to build 18 or later
>> >> >>>
>> >> >>> On Sat, Mar 27, 2010 at 10:55 AM, Eric Yu <su...@gmail.com> wrote:
>> >> >>> > Hi, list
>> >> >>> > I got this exception when insert into a cluster with 5 node, is
>> >> >>> > this
>> >> >>> > a
>> >> >>> > bug
>> >> >>> > or something else is wrong.
>> >> >>> >
>> >> >>> > here is the system log:
>> >> >>> >
>> >> >>> > INFO [GMFD:1] 2010-03-27 23:15:16,145 Gossiper.java (line 543)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now UP
>> >> >>> > ERROR [Timer-1] 2010-03-27 23:23:27,739 TcpConnection.java (line
>> >> >>> > 308)
>> >> >>> > Closing down connection java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:58261 remote=/172.19.15.210:7000] with
>> >> >>> > 342218
>> >> >>> > writes
>> >> >>> > remaining.
>> >> >>> > INFO [Timer-1] 2010-03-27 23:23:27,792 Gossiper.java (line 194)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now dead.
>> >> >>> > INFO [GMFD:1] 2010-03-27 23:23:32,214 Gossiper.java (line 543)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now UP
>> >> >>> > ERROR [Timer-1] 2010-03-27 23:24:47,846 TcpConnection.java (line
>> >> >>> > 308)
>> >> >>> > Closing down connection java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:59801 remote=/172.19.15.210:7000] with
>> >> >>> > 256285
>> >> >>> > writes
>> >> >>> > remaining.
>> >> >>> > INFO [Timer-1] 2010-03-27 23:24:47,846 Gossiper.java (line 194)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now dead.
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:1] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 484) Problem reading from socket connected to :
>> >> >>> > java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:7000
>> >> >>> > remote=/172.19.15.210:55473]
>> >> >>> > INFO [GMFD:1] 2010-03-27 23:25:05,580 Gossiper.java (line 543)
>> >> >>> > InetAddress
>> >> >>> > /172.19.15.210 is now UP
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 484) Problem reading from socket connected to :
>> >> >>> > java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:7000
>> >> >>> > remote=/172.19.15.210:45504]
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 485) Exception was generated at : 03/27/2010 23:25:05 on
>> >> >>> > thread
>> >> >>> > MESSAGING-SERVICE-POOL:2
>> >> >>> > Reached an EOL or something bizzare occured. Reading from:
>> >> >>> > /172.19.15.210
>> >> >>> > BufferSizeRemaining: 16
>> >> >>> > java.io.IOException: Reached an EOL or something bizzare occured.
>> >> >>> > Reading
>> >> >>> > from: /172.19.15.210 BufferSizeRemaining: 16
>> >> >>> > at
>> >> >>> > org.apache.cassandra.net.io.StartState.doRead(StartState.java:44)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> > org.apache.cassandra.net.io.ProtocolState.read(ProtocolState.java:39)
>> >> >>> > at
>> >> >>> > org.apache.cassandra.net.io.TcpReader.read(TcpReader.java:95)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > org.apache.cassandra.net.TcpConnection$ReadWorkItem.run(TcpConnection.java:445)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>> >> >>> > at
>> >> >>> >
>> >> >>> >
>> >> >>> >
>> >> >>> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>> >> >>> > at java.lang.Thread.run(Thread.java:636)
>> >> >>> >
>> >> >>> > INFO [MESSAGING-SERVICE-POOL:2] 2010-03-27 23:25:05,580
>> >> >>> > TcpConnection.java
>> >> >>> > (line 315) Closing errored connection
>> >> >>> > java.nio.channels.SocketChannel[connected
>> >> >>> > local=/172.19.15.209:7000
>> >> >>> > remote=/172.19.15.210:45504]
>> >> >>> > WARN [MESSAGING-SERVICE-POOL:1] 2010-03-27 23:25:05,632
>> >> >>> > TcpConnection.java
>> >> >>> > (line 485) Exception was generated at : 03/27/2010 23:25:05 on
>> >> >>> > thread
>> >> >>> > MESSAGING-SERVICE-POOL:1
>> >> >>> >
>> >> >>
>> >> >
>> >> >
>> >
>> >
>
>
>
> --
> Best Regards
> Anty Rao
>