You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by "Emley, Andrew" <An...@eon.com> on 2015/04/28 17:59:12 UTC

zookeeper restart fatal error

Hi

I have had zk and kafka(2_8.0-0.8.1) set up nicely running for a week or so, I decided to stop the zk and the kafka brokers and re-start them, since stopping zk I can't start it again!! It gives me this fatal exception that is related to one of my test topics "multinode1partition4reptopic"!?

Can anyone give me any pointers on how to resolve?

Many thanks
andy


[2015-04-28 16:31:05,282] ERROR Failed to increment parent cversion for: /consumers/console-consumer-22432/offsets/multinode1partition4reptopic (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /consumers/console-consumer-22432/offsets/multinode1partition4reptopic
        at org.apache.zookeeper.server.DataTree.incrementCversion(DataTree.java:1218)
        at org.apache.zookeeper.server.persistence.FileTxnSnapLog.processTransaction(FileTxnSnapLog.java:222)
        at org.apache.zookeeper.server.persistence.FileTxnSnapLog.restore(FileTxnSnapLog.java:150)
        at org.apache.zookeeper.server.ZKDatabase.loadDataBase(ZKDatabase.java:222)
        at org.apache.zookeeper.server.ZooKeeperServer.loadData(ZooKeeperServer.java:239)
        at org.apache.zookeeper.server.ZooKeeperServer.startdata(ZooKeeperServer.java:366)
        at org.apache.zookeeper.server.NIOServerCnxn$Factory.startup(NIOServerCnxn.java:160)
        at org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:110)
        at org.apache.zookeeper.server.ZooKeeperServerMain.initializeAndRun(ZooKeeperServerMain.java:85)
        at org.apache.zookeeper.server.ZooKeeperServerMain.main(ZooKeeperServerMain.java:51)
        at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:108)
        at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:76)
[2015-04-28 16:31:05,289] FATAL Unexpected exception, exiting abnormally (org.apache.zookeeper.server.ZooKeeperServerMain)
java.io.IOException: Failed to process transaction type: 2 error: KeeperErrorCode = NoNode for /consumers/console-consumer-22432/offsets/multinode1partition4reptopic
        at org.apache.zookeeper.server.persistence.FileTxnSnapLog.restore(FileTxnSnapLog.java:152)
        at org.apache.zookeeper.server.ZKDatabase.loadDataBase(ZKDatabase.java:222)
        at org.apache.zookeeper.server.ZooKeeperServer.loadData(ZooKeeperServer.java:239)
        at org.apache.zookeeper.server.ZooKeeperServer.startdata(ZooKeeperServer.java:366)
        at org.apache.zookeeper.server.NIOServerCnxn$Factory.startup(NIOServerCnxn.java:160)
        at org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:110)
        at org.apache.zookeeper.server.ZooKeeperServerMain.initializeAndRun(ZooKeeperServerMain.java:85)
        at org.apache.zookeeper.server.ZooKeeperServerMain.main(ZooKeeperServerMain.java:51)
        at org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:108)
        at org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:76)

Re: zookeeper restart fatal error

Posted by David Corley <da...@gmail.com>.
Unfortunately sounds like a Zookeeper data corruption issue on the node in
question:
https://issues.apache.org/jira/browse/ZOOKEEPER-1546

The fix from the Jira is to clean out the Zookeeper data on the affected
node (if that's possible)

On 28 April 2015 at 16:59, Emley, Andrew <An...@eon.com> wrote:

> Hi
>
> I have had zk and kafka(2_8.0-0.8.1) set up nicely running for a week or
> so, I decided to stop the zk and the kafka brokers and re-start them, since
> stopping zk I can't start it again!! It gives me this fatal exception that
> is related to one of my test topics "multinode1partition4reptopic"!?
>
> Can anyone give me any pointers on how to resolve?
>
> Many thanks
> andy
>
>
> [2015-04-28 16:31:05,282] ERROR Failed to increment parent cversion for:
> /consumers/console-consumer-22432/offsets/multinode1partition4reptopic
> (org.apache.zookeeper.server.persistence.FileTxnSnapLog)
> org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode =
> NoNode for
> /consumers/console-consumer-22432/offsets/multinode1partition4reptopic
>         at
> org.apache.zookeeper.server.DataTree.incrementCversion(DataTree.java:1218)
>         at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.processTransaction(FileTxnSnapLog.java:222)
>         at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.restore(FileTxnSnapLog.java:150)
>         at
> org.apache.zookeeper.server.ZKDatabase.loadDataBase(ZKDatabase.java:222)
>         at
> org.apache.zookeeper.server.ZooKeeperServer.loadData(ZooKeeperServer.java:239)
>         at
> org.apache.zookeeper.server.ZooKeeperServer.startdata(ZooKeeperServer.java:366)
>         at
> org.apache.zookeeper.server.NIOServerCnxn$Factory.startup(NIOServerCnxn.java:160)
>         at
> org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:110)
>         at
> org.apache.zookeeper.server.ZooKeeperServerMain.initializeAndRun(ZooKeeperServerMain.java:85)
>         at
> org.apache.zookeeper.server.ZooKeeperServerMain.main(ZooKeeperServerMain.java:51)
>         at
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:108)
>         at
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:76)
> [2015-04-28 16:31:05,289] FATAL Unexpected exception, exiting abnormally
> (org.apache.zookeeper.server.ZooKeeperServerMain)
> java.io.IOException: Failed to process transaction type: 2 error:
> KeeperErrorCode = NoNode for
> /consumers/console-consumer-22432/offsets/multinode1partition4reptopic
>         at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.restore(FileTxnSnapLog.java:152)
>         at
> org.apache.zookeeper.server.ZKDatabase.loadDataBase(ZKDatabase.java:222)
>         at
> org.apache.zookeeper.server.ZooKeeperServer.loadData(ZooKeeperServer.java:239)
>         at
> org.apache.zookeeper.server.ZooKeeperServer.startdata(ZooKeeperServer.java:366)
>         at
> org.apache.zookeeper.server.NIOServerCnxn$Factory.startup(NIOServerCnxn.java:160)
>         at
> org.apache.zookeeper.server.ZooKeeperServerMain.runFromConfig(ZooKeeperServerMain.java:110)
>         at
> org.apache.zookeeper.server.ZooKeeperServerMain.initializeAndRun(ZooKeeperServerMain.java:85)
>         at
> org.apache.zookeeper.server.ZooKeeperServerMain.main(ZooKeeperServerMain.java:51)
>         at
> org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:108)
>         at
> org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:76)
>
>
>
>
>