You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by tao xiao <xi...@gmail.com> on 2015/02/09 12:07:08 UTC
Got ClosedByInterruptException when closing ConsumerConnector
Hi team,
I got java.nio.channels.ClosedByInterruptException when
closing ConsumerConnector using kafka 0.8.2
Here is the exception
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[test12345_localhost], ZKConsumerConnector shutting down
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[ConsumerFetcherManager-1423479848796] Stopping leader finder thread
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[test12345_localhost], Shutting down
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[test12345_localhost], Shutdown completed
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[ConsumerFetcherManager-1423479848796] Stopping all fetchers
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[test12345_localhost], Stopped
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[ConsumerFetcherThread-test12345_localhost], Shutting down
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 - Reconnect due to
socket error: java.nio.channels.ClosedByInterruptException
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[ConsumerFetcherThread-test12345_localhost], Stopped
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[ConsumerFetcherThread-test12345_localhost], Shutdown completed
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[ConsumerFetcherManager-1423479848796] All connections stopped
2015-02-09 19:04:19 INFO org.I0Itec.zkclient.ZkEventThread:82 - Terminate
ZkClient event thread.
2015-02-09 19:04:19 INFO org.apache.zookeeper.ZooKeeper:684 - Session:
0x14b6dd8fcf80011 closed
2015-02-09 19:04:19 INFO org.apache.zookeeper.ClientCnxn$EventThread:512 -
EventThread shut down
2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
[test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms
--
Regards,
Tao
Re: Got ClosedByInterruptException when closing ConsumerConnector
Posted by Guozhang Wang <wa...@gmail.com>.
This exception should be transient (and that is why we captured it as INFO
level log entries) and can be ignored.
We are currently working on the new consumer APIs, and will improve our
logging pattern to avoid such confusing information.
Guozhang
On Mon, Feb 9, 2015 at 5:33 PM, tao xiao <xi...@gmail.com> wrote:
> It happens every time I shutdown the connector. It doesn't block the
> shutdown process though
>
> On Tue, Feb 10, 2015 at 1:09 AM, Guozhang Wang <wa...@gmail.com> wrote:
>
> > Is this exception transient or consistent and blocking the shutdown
> > process?
> >
> > On Mon, Feb 9, 2015 at 3:07 AM, tao xiao <xi...@gmail.com> wrote:
> >
> > > Hi team,
> > >
> > > I got java.nio.channels.ClosedByInterruptException when
> > > closing ConsumerConnector using kafka 0.8.2
> > >
> > > Here is the exception
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [test12345_localhost], ZKConsumerConnector shutting down
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [ConsumerFetcherManager-1423479848796] Stopping leader finder thread
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [test12345_localhost], Shutting down
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [test12345_localhost], Shutdown completed
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [ConsumerFetcherManager-1423479848796] Stopping all fetchers
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [test12345_localhost], Stopped
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [ConsumerFetcherThread-test12345_localhost], Shutting down
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 - Reconnect due
> to
> > > socket error: java.nio.channels.ClosedByInterruptException
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [ConsumerFetcherThread-test12345_localhost], Stopped
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [ConsumerFetcherThread-test12345_localhost], Shutdown completed
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [ConsumerFetcherManager-1423479848796] All connections stopped
> > >
> > > 2015-02-09 19:04:19 INFO org.I0Itec.zkclient.ZkEventThread:82 -
> > Terminate
> > > ZkClient event thread.
> > >
> > > 2015-02-09 19:04:19 INFO org.apache.zookeeper.ZooKeeper:684 - Session:
> > > 0x14b6dd8fcf80011 closed
> > >
> > > 2015-02-09 19:04:19 INFO
> > org.apache.zookeeper.ClientCnxn$EventThread:512 -
> > > EventThread shut down
> > >
> > > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > > [test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms
> > >
> > >
> > > --
> > > Regards,
> > > Tao
> > >
> >
> >
> >
> > --
> > -- Guozhang
> >
>
>
>
> --
> Regards,
> Tao
>
--
-- Guozhang
Re: Got ClosedByInterruptException when closing ConsumerConnector
Posted by tao xiao <xi...@gmail.com>.
It happens every time I shutdown the connector. It doesn't block the
shutdown process though
On Tue, Feb 10, 2015 at 1:09 AM, Guozhang Wang <wa...@gmail.com> wrote:
> Is this exception transient or consistent and blocking the shutdown
> process?
>
> On Mon, Feb 9, 2015 at 3:07 AM, tao xiao <xi...@gmail.com> wrote:
>
> > Hi team,
> >
> > I got java.nio.channels.ClosedByInterruptException when
> > closing ConsumerConnector using kafka 0.8.2
> >
> > Here is the exception
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [test12345_localhost], ZKConsumerConnector shutting down
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [ConsumerFetcherManager-1423479848796] Stopping leader finder thread
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [test12345_localhost], Shutting down
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [test12345_localhost], Shutdown completed
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [ConsumerFetcherManager-1423479848796] Stopping all fetchers
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [test12345_localhost], Stopped
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [ConsumerFetcherThread-test12345_localhost], Shutting down
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 - Reconnect due to
> > socket error: java.nio.channels.ClosedByInterruptException
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [ConsumerFetcherThread-test12345_localhost], Stopped
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [ConsumerFetcherThread-test12345_localhost], Shutdown completed
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [ConsumerFetcherManager-1423479848796] All connections stopped
> >
> > 2015-02-09 19:04:19 INFO org.I0Itec.zkclient.ZkEventThread:82 -
> Terminate
> > ZkClient event thread.
> >
> > 2015-02-09 19:04:19 INFO org.apache.zookeeper.ZooKeeper:684 - Session:
> > 0x14b6dd8fcf80011 closed
> >
> > 2015-02-09 19:04:19 INFO
> org.apache.zookeeper.ClientCnxn$EventThread:512 -
> > EventThread shut down
> >
> > 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> > [test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms
> >
> >
> > --
> > Regards,
> > Tao
> >
>
>
>
> --
> -- Guozhang
>
--
Regards,
Tao
Re: Got ClosedByInterruptException when closing ConsumerConnector
Posted by Guozhang Wang <wa...@gmail.com>.
Is this exception transient or consistent and blocking the shutdown process?
On Mon, Feb 9, 2015 at 3:07 AM, tao xiao <xi...@gmail.com> wrote:
> Hi team,
>
> I got java.nio.channels.ClosedByInterruptException when
> closing ConsumerConnector using kafka 0.8.2
>
> Here is the exception
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [test12345_localhost], ZKConsumerConnector shutting down
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [ConsumerFetcherManager-1423479848796] Stopping leader finder thread
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [test12345_localhost], Shutting down
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [test12345_localhost], Shutdown completed
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [ConsumerFetcherManager-1423479848796] Stopping all fetchers
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [test12345_localhost], Stopped
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [ConsumerFetcherThread-test12345_localhost], Shutting down
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 - Reconnect due to
> socket error: java.nio.channels.ClosedByInterruptException
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [ConsumerFetcherThread-test12345_localhost], Stopped
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [ConsumerFetcherThread-test12345_localhost], Shutdown completed
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [ConsumerFetcherManager-1423479848796] All connections stopped
>
> 2015-02-09 19:04:19 INFO org.I0Itec.zkclient.ZkEventThread:82 - Terminate
> ZkClient event thread.
>
> 2015-02-09 19:04:19 INFO org.apache.zookeeper.ZooKeeper:684 - Session:
> 0x14b6dd8fcf80011 closed
>
> 2015-02-09 19:04:19 INFO org.apache.zookeeper.ClientCnxn$EventThread:512 -
> EventThread shut down
>
> 2015-02-09 19:04:19 INFO kafka.utils.Logging$class:68 -
> [test12345_localhost], ZKConsumerConnector shutdown completed in 86 ms
>
>
> --
> Regards,
> Tao
>
--
-- Guozhang