You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Marina <pp...@yahoo.com.INVALID> on 2015/07/17 02:42:30 UTC
Re: Delete topic using kafka-topics.sh also not working (or takes
forever)
A variation on the posted question - as a new thread so that not to high-jack the original one...
How long does it usually take to finally delete the topic? I tried to delete the topic via
/bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic mytopic
and saw that it was "marked for deletion". However, about 30 hours later, the topic is still showing up in the list of topics:
=> bin/kafka-topics.sh --list --zookeeper localhost:2181
__consumer_offsets
mytopic
The topic did have about 150 million events as Log size, but none were unprocessed (Lag == 0).
As a test , I tried to create a new topic , and delete it right away with no events posted - and in that case it was deleted for good right away.
I'm using kafka 1.8.2.1
thanks!MArina
From: Stevo Slavić <ss...@gmail.com>
To: users@kafka.apache.org
Sent: Thursday, July 16, 2015 6:56 PM
Subject: Re: Delete topic using Admintools is not working
Hello Sivananda,
Calling AdminUtils.deleteTopic just requests topic to be deleted - it does
not actually delete topic immediately. Requests for topic deletion get
saved in ZooKeeper as a node (named by topic name), under
/admin/delete_topics node.
If brokers in the cluster are configured with topic deletion enabled, and
if they are running, they will notice requests to delete the topic, perform
actual deletion (all partitions on all brokers, lead and replicas, as well
as deletion of topic metadata in zookeeper), and also delete saved request
for topic deletion (that node under /admin/delete_topics). This broker side
part of topic deletion process is only working in Kafka 0.8.2.x.
>From your stack trace it seems you've requested topic deletion at least
twice, while topic has not been deleted yet, so zk client used by admin
utils, throws exception signalling that the node (request for topic
deletion) already exists.
If topic is not getting deleted even after a while I'd suggest that you
check version, configuration and running status of your Kafka cluster.
Kind regards,
Stevo Slavic.
On Fri, Jul 17, 2015 at 12:40 AM, Sivananda Reddy <si...@gmail.com>
wrote:
> Hi,
>
> As per the jira https://issues.apache.org/jira/browse/KAFKA-1737, I have
> set ZKStringSerializer, while creating the ZkClient and still the delete
> topic function call is not working:
>
> Version: kafka_2.11-0.8.2.1
>
> *My code looks like this*:
> ZkClient zkClient = new ZkClient("localhost:2181", 6000, 6000,
> ZKStringSerializer$.MODULE$);
> AdminUtils.deleteTopic(zkClient, "testTopic17");
>
> *I am getting the following exception's*:
> Exception in thread "main"
> org.I0Itec.zkclient.exception.ZkNodeExistsException:
> org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode =
> NodeExists for /admin/delete_topics/testTopic17
> at
> org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55)
> at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
> at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243)
> at kafka.utils.ZkUtils$.createPersistentPath(ZkUtils.scala:306)
> at kafka.admin.AdminUtils$.deleteTopic(AdminUtils.scala:159)
> at kafka.admin.AdminUtils.deleteTopic(AdminUtils.scala)
> at Test.deleteTopic(Test.java:98)
> at Test.main(Test.java:76)
> Caused by: org.apache.zookeeper.KeeperException$NodeExistsException:
> KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> ... 7 more
>
> *The corresponding zookeeper logs*:
> [2015-07-16 15:31:14,383] INFO Accepted socket connection from /
> 127.0.0.1:23363 (org.apache.zookeeper.server.NIOServerCnxnFactory)
> [2015-07-16 15:31:14,385] INFO Client attempting to establish new session
> at /127.0.0.1:23363 (org.apache.zookeeper.server.ZooKeeperServer)
> [2015-07-16 15:31:14,391] INFO Established session 0x14e98d2ce98000c with
> negotiated timeout 6000 for client /127.0.0.1:23363
> (org.apache.zookeeper.server.ZooKeeperServer)
> [2015-07-16 15:31:14,510] INFO Got user-level KeeperException when
> processing sessionid:0x14e98d2ce98000c type:create cxid:0x1 zxid:0x963
> txntype:-1 reqpath:n/a Error Path:/admin/delete_topics/testTopic17
> Error:KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> (org.apache.zookeeper.server.PrepRequestProcessor)
> [2015-07-16 15:31:14,842] WARN caught end of stream exception
> (org.apache.zookeeper.server.NIOServerCnxn)
> EndOfStreamException: Unable to read additional data from client sessionid
> 0x14e98d2ce98000c, likely client has closed socket
> at
> org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> at
>
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> at java.lang.Thread.run(Thread.java:744)
> [2015-07-16 15:31:14,843] INFO Closed socket connection for client /
> 127.0.0.1:23363 which had sessionid 0x14e98d2ce98000c
> (org.apache.zookeeper.server.NIOServerCnxn)
> [2015-07-16 15:31:21,000] INFO Expiring session 0x14e98d2ce98000c, timeout
> of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
> [2015-07-16 15:31:21,001] INFO Processed session termination for sessionid:
> 0x14e98d2ce98000c (org.apache.zookeeper.server.PrepRequestProcessor)
>
> Could someone please let me know if I am missing anything?
>
> Thank you,
> Siva.
>
Re: Delete topic using kafka-topics.sh also not working (or takes
forever)
Posted by Marina <pp...@yahoo.com.INVALID>.
Jeifu, Ashish,Thanks for your response.
1. the log retention was set to 24 hrs:log.retention.hours=24
so, it seems like the topic was still there even after the retention period has passed.
2. I was not able to reproduce the issue with a small amount of data - up to a few dozen events. But I see this consistently when I have more than 100M events. I know it is a wide range :) - so I will try to ramp it up gradually, I just have to write a couple of scripts for that.
thanks!Marina
From: JIEFU GONG <jg...@berkeley.edu>
To: users@kafka.apache.org
Sent: Friday, July 17, 2015 2:56 PM
Subject: Re: Delete topic using kafka-topics.sh also not working (or takes forever)
How long do you have your retention configuration set for under
server.properties? Is it under 30 hours?
On Thu, Jul 16, 2015 at 10:44 PM, Ashish Singh <as...@cloudera.com> wrote:
> Hi Marina,
>
> Is this reproducible? Can you reproduce this with a smaller number of
> events? Did you see any error in broker /server logs?
>
> On Thu, Jul 16, 2015 at 5:42 PM, Marina <pp...@yahoo.com.invalid> wrote:
>
> > A variation on the posted question - as a new thread so that not to
> > high-jack the original one...
> > How long does it usually take to finally delete the topic? I tried to
> > delete the topic via
> > /bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic mytopic
> > and saw that it was "marked for deletion". However, about 30 hours
> later,
> > the topic is still showing up in the list of topics:
> > => bin/kafka-topics.sh --list --zookeeper localhost:2181
> > __consumer_offsets
> > mytopic
> >
> > The topic did have about 150 million events as Log size, but none were
> > unprocessed (Lag == 0).
> > As a test , I tried to create a new topic , and delete it right away with
> > no events posted - and in that case it was deleted for good right away.
> > I'm using kafka 1.8.2.1
> > thanks!MArina
> >
> > From: Stevo Slavić <ss...@gmail.com>
> > To: users@kafka.apache.org
> > Sent: Thursday, July 16, 2015 6:56 PM
> > Subject: Re: Delete topic using Admintools is not working
> >
> > Hello Sivananda,
> >
> > Calling AdminUtils.deleteTopic just requests topic to be deleted - it
> does
> > not actually delete topic immediately. Requests for topic deletion get
> > saved in ZooKeeper as a node (named by topic name), under
> > /admin/delete_topics node.
> >
> > If brokers in the cluster are configured with topic deletion enabled, and
> > if they are running, they will notice requests to delete the topic,
> perform
> > actual deletion (all partitions on all brokers, lead and replicas, as
> well
> > as deletion of topic metadata in zookeeper), and also delete saved
> request
> > for topic deletion (that node under /admin/delete_topics). This broker
> side
> > part of topic deletion process is only working in Kafka 0.8.2.x.
> >
> > From your stack trace it seems you've requested topic deletion at least
> > twice, while topic has not been deleted yet, so zk client used by admin
> > utils, throws exception signalling that the node (request for topic
> > deletion) already exists.
> >
> > If topic is not getting deleted even after a while I'd suggest that you
> > check version, configuration and running status of your Kafka cluster.
> >
> > Kind regards,
> > Stevo Slavic.
> >
> >
> >
> > On Fri, Jul 17, 2015 at 12:40 AM, Sivananda Reddy <
> sivananda2510@gmail.com
> > >
> > wrote:
> >
> > > Hi,
> > >
> > > As per the jira https://issues.apache.org/jira/browse/KAFKA-1737, I
> have
> > > set ZKStringSerializer, while creating the ZkClient and still the
> delete
> > > topic function call is not working:
> > >
> > > Version: kafka_2.11-0.8.2.1
> > >
> > > *My code looks like this*:
> > > ZkClient zkClient = new ZkClient("localhost:2181", 6000, 6000,
> > > ZKStringSerializer$.MODULE$);
> > > AdminUtils.deleteTopic(zkClient, "testTopic17");
> > >
> > > *I am getting the following exception's*:
> > > Exception in thread "main"
> > > org.I0Itec.zkclient.exception.ZkNodeExistsException:
> > > org.apache.zookeeper.KeeperException$NodeExistsException:
> > KeeperErrorCode =
> > > NodeExists for /admin/delete_topics/testTopic17
> > > at
> > > org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55)
> > > at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
> > > at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> > > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243)
> > > at kafka.utils.ZkUtils$.createPersistentPath(ZkUtils.scala:306)
> > > at kafka.admin.AdminUtils$.deleteTopic(AdminUtils.scala:159)
> > > at kafka.admin.AdminUtils.deleteTopic(AdminUtils.scala)
> > > at Test.deleteTopic(Test.java:98)
> > > at Test.main(Test.java:76)
> > > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException:
> > > KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > > at
> > > org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> > > at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> > > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> > > at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> > > at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> > > ... 7 more
> > >
> > > *The corresponding zookeeper logs*:
> > > [2015-07-16 15:31:14,383] INFO Accepted socket connection from /
> > > 127.0.0.1:23363 (org.apache.zookeeper.server.NIOServerCnxnFactory)
> > > [2015-07-16 15:31:14,385] INFO Client attempting to establish new
> session
> > > at /127.0.0.1:23363 (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:14,391] INFO Established session 0x14e98d2ce98000c
> with
> > > negotiated timeout 6000 for client /127.0.0.1:23363
> > > (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:14,510] INFO Got user-level KeeperException when
> > > processing sessionid:0x14e98d2ce98000c type:create cxid:0x1 zxid:0x963
> > > txntype:-1 reqpath:n/a Error Path:/admin/delete_topics/testTopic17
> > > Error:KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > > (org.apache.zookeeper.server.PrepRequestProcessor)
> > > [2015-07-16 15:31:14,842] WARN caught end of stream exception
> > > (org.apache.zookeeper.server.NIOServerCnxn)
> > > EndOfStreamException: Unable to read additional data from client
> > sessionid
> > > 0x14e98d2ce98000c, likely client has closed socket
> > > at
> > > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> > > at
> > >
> > >
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> > > at java.lang.Thread.run(Thread.java:744)
> > > [2015-07-16 15:31:14,843] INFO Closed socket connection for client /
> > > 127.0.0.1:23363 which had sessionid 0x14e98d2ce98000c
> > > (org.apache.zookeeper.server.NIOServerCnxn)
> > > [2015-07-16 15:31:21,000] INFO Expiring session 0x14e98d2ce98000c,
> > timeout
> > > of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:21,001] INFO Processed session termination for
> > sessionid:
> > > 0x14e98d2ce98000c (org.apache.zookeeper.server.PrepRequestProcessor)
> > >
> > > Could someone please let me know if I am missing anything?
> > >
> > > Thank you,
> > > Siva.
> > >
> >
> >
> >
>
>
>
>
> --
>
> Regards,
> Ashish
>
--
Jiefu Gong
University of California, Berkeley | Class of 2017
B.A Computer Science | College of Letters and Sciences
jgong@berkeley.edu <el...@berkeley.edu> | (925) 400-3427
Re: Delete topic using kafka-topics.sh also not working (or takes forever)
Posted by JIEFU GONG <jg...@berkeley.edu>.
How long do you have your retention configuration set for under
server.properties? Is it under 30 hours?
On Thu, Jul 16, 2015 at 10:44 PM, Ashish Singh <as...@cloudera.com> wrote:
> Hi Marina,
>
> Is this reproducible? Can you reproduce this with a smaller number of
> events? Did you see any error in broker /server logs?
>
> On Thu, Jul 16, 2015 at 5:42 PM, Marina <pp...@yahoo.com.invalid> wrote:
>
> > A variation on the posted question - as a new thread so that not to
> > high-jack the original one...
> > How long does it usually take to finally delete the topic? I tried to
> > delete the topic via
> > /bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic mytopic
> > and saw that it was "marked for deletion". However, about 30 hours
> later,
> > the topic is still showing up in the list of topics:
> > => bin/kafka-topics.sh --list --zookeeper localhost:2181
> > __consumer_offsets
> > mytopic
> >
> > The topic did have about 150 million events as Log size, but none were
> > unprocessed (Lag == 0).
> > As a test , I tried to create a new topic , and delete it right away with
> > no events posted - and in that case it was deleted for good right away.
> > I'm using kafka 1.8.2.1
> > thanks!MArina
> >
> > From: Stevo Slavić <ss...@gmail.com>
> > To: users@kafka.apache.org
> > Sent: Thursday, July 16, 2015 6:56 PM
> > Subject: Re: Delete topic using Admintools is not working
> >
> > Hello Sivananda,
> >
> > Calling AdminUtils.deleteTopic just requests topic to be deleted - it
> does
> > not actually delete topic immediately. Requests for topic deletion get
> > saved in ZooKeeper as a node (named by topic name), under
> > /admin/delete_topics node.
> >
> > If brokers in the cluster are configured with topic deletion enabled, and
> > if they are running, they will notice requests to delete the topic,
> perform
> > actual deletion (all partitions on all brokers, lead and replicas, as
> well
> > as deletion of topic metadata in zookeeper), and also delete saved
> request
> > for topic deletion (that node under /admin/delete_topics). This broker
> side
> > part of topic deletion process is only working in Kafka 0.8.2.x.
> >
> > From your stack trace it seems you've requested topic deletion at least
> > twice, while topic has not been deleted yet, so zk client used by admin
> > utils, throws exception signalling that the node (request for topic
> > deletion) already exists.
> >
> > If topic is not getting deleted even after a while I'd suggest that you
> > check version, configuration and running status of your Kafka cluster.
> >
> > Kind regards,
> > Stevo Slavic.
> >
> >
> >
> > On Fri, Jul 17, 2015 at 12:40 AM, Sivananda Reddy <
> sivananda2510@gmail.com
> > >
> > wrote:
> >
> > > Hi,
> > >
> > > As per the jira https://issues.apache.org/jira/browse/KAFKA-1737, I
> have
> > > set ZKStringSerializer, while creating the ZkClient and still the
> delete
> > > topic function call is not working:
> > >
> > > Version: kafka_2.11-0.8.2.1
> > >
> > > *My code looks like this*:
> > > ZkClient zkClient = new ZkClient("localhost:2181", 6000, 6000,
> > > ZKStringSerializer$.MODULE$);
> > > AdminUtils.deleteTopic(zkClient, "testTopic17");
> > >
> > > *I am getting the following exception's*:
> > > Exception in thread "main"
> > > org.I0Itec.zkclient.exception.ZkNodeExistsException:
> > > org.apache.zookeeper.KeeperException$NodeExistsException:
> > KeeperErrorCode =
> > > NodeExists for /admin/delete_topics/testTopic17
> > > at
> > > org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55)
> > > at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
> > > at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> > > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243)
> > > at kafka.utils.ZkUtils$.createPersistentPath(ZkUtils.scala:306)
> > > at kafka.admin.AdminUtils$.deleteTopic(AdminUtils.scala:159)
> > > at kafka.admin.AdminUtils.deleteTopic(AdminUtils.scala)
> > > at Test.deleteTopic(Test.java:98)
> > > at Test.main(Test.java:76)
> > > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException:
> > > KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > > at
> > > org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> > > at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> > > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> > > at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> > > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> > > at
> org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> > > ... 7 more
> > >
> > > *The corresponding zookeeper logs*:
> > > [2015-07-16 15:31:14,383] INFO Accepted socket connection from /
> > > 127.0.0.1:23363 (org.apache.zookeeper.server.NIOServerCnxnFactory)
> > > [2015-07-16 15:31:14,385] INFO Client attempting to establish new
> session
> > > at /127.0.0.1:23363 (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:14,391] INFO Established session 0x14e98d2ce98000c
> with
> > > negotiated timeout 6000 for client /127.0.0.1:23363
> > > (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:14,510] INFO Got user-level KeeperException when
> > > processing sessionid:0x14e98d2ce98000c type:create cxid:0x1 zxid:0x963
> > > txntype:-1 reqpath:n/a Error Path:/admin/delete_topics/testTopic17
> > > Error:KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > > (org.apache.zookeeper.server.PrepRequestProcessor)
> > > [2015-07-16 15:31:14,842] WARN caught end of stream exception
> > > (org.apache.zookeeper.server.NIOServerCnxn)
> > > EndOfStreamException: Unable to read additional data from client
> > sessionid
> > > 0x14e98d2ce98000c, likely client has closed socket
> > > at
> > > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> > > at
> > >
> > >
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> > > at java.lang.Thread.run(Thread.java:744)
> > > [2015-07-16 15:31:14,843] INFO Closed socket connection for client /
> > > 127.0.0.1:23363 which had sessionid 0x14e98d2ce98000c
> > > (org.apache.zookeeper.server.NIOServerCnxn)
> > > [2015-07-16 15:31:21,000] INFO Expiring session 0x14e98d2ce98000c,
> > timeout
> > > of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
> > > [2015-07-16 15:31:21,001] INFO Processed session termination for
> > sessionid:
> > > 0x14e98d2ce98000c (org.apache.zookeeper.server.PrepRequestProcessor)
> > >
> > > Could someone please let me know if I am missing anything?
> > >
> > > Thank you,
> > > Siva.
> > >
> >
> >
> >
>
>
>
>
> --
>
> Regards,
> Ashish
>
--
Jiefu Gong
University of California, Berkeley | Class of 2017
B.A Computer Science | College of Letters and Sciences
jgong@berkeley.edu <el...@berkeley.edu> | (925) 400-3427
Re: Delete topic using kafka-topics.sh also not working (or takes forever)
Posted by Ashish Singh <as...@cloudera.com>.
Hi Marina,
Is this reproducible? Can you reproduce this with a smaller number of
events? Did you see any error in broker /server logs?
On Thu, Jul 16, 2015 at 5:42 PM, Marina <pp...@yahoo.com.invalid> wrote:
> A variation on the posted question - as a new thread so that not to
> high-jack the original one...
> How long does it usually take to finally delete the topic? I tried to
> delete the topic via
> /bin/kafka-topics.sh --delete --zookeeper localhost:2181 --topic mytopic
> and saw that it was "marked for deletion". However, about 30 hours later,
> the topic is still showing up in the list of topics:
> => bin/kafka-topics.sh --list --zookeeper localhost:2181
> __consumer_offsets
> mytopic
>
> The topic did have about 150 million events as Log size, but none were
> unprocessed (Lag == 0).
> As a test , I tried to create a new topic , and delete it right away with
> no events posted - and in that case it was deleted for good right away.
> I'm using kafka 1.8.2.1
> thanks!MArina
>
> From: Stevo Slavić <ss...@gmail.com>
> To: users@kafka.apache.org
> Sent: Thursday, July 16, 2015 6:56 PM
> Subject: Re: Delete topic using Admintools is not working
>
> Hello Sivananda,
>
> Calling AdminUtils.deleteTopic just requests topic to be deleted - it does
> not actually delete topic immediately. Requests for topic deletion get
> saved in ZooKeeper as a node (named by topic name), under
> /admin/delete_topics node.
>
> If brokers in the cluster are configured with topic deletion enabled, and
> if they are running, they will notice requests to delete the topic, perform
> actual deletion (all partitions on all brokers, lead and replicas, as well
> as deletion of topic metadata in zookeeper), and also delete saved request
> for topic deletion (that node under /admin/delete_topics). This broker side
> part of topic deletion process is only working in Kafka 0.8.2.x.
>
> From your stack trace it seems you've requested topic deletion at least
> twice, while topic has not been deleted yet, so zk client used by admin
> utils, throws exception signalling that the node (request for topic
> deletion) already exists.
>
> If topic is not getting deleted even after a while I'd suggest that you
> check version, configuration and running status of your Kafka cluster.
>
> Kind regards,
> Stevo Slavic.
>
>
>
> On Fri, Jul 17, 2015 at 12:40 AM, Sivananda Reddy <sivananda2510@gmail.com
> >
> wrote:
>
> > Hi,
> >
> > As per the jira https://issues.apache.org/jira/browse/KAFKA-1737, I have
> > set ZKStringSerializer, while creating the ZkClient and still the delete
> > topic function call is not working:
> >
> > Version: kafka_2.11-0.8.2.1
> >
> > *My code looks like this*:
> > ZkClient zkClient = new ZkClient("localhost:2181", 6000, 6000,
> > ZKStringSerializer$.MODULE$);
> > AdminUtils.deleteTopic(zkClient, "testTopic17");
> >
> > *I am getting the following exception's*:
> > Exception in thread "main"
> > org.I0Itec.zkclient.exception.ZkNodeExistsException:
> > org.apache.zookeeper.KeeperException$NodeExistsException:
> KeeperErrorCode =
> > NodeExists for /admin/delete_topics/testTopic17
> > at
> > org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:55)
> > at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
> > at org.I0Itec.zkclient.ZkClient.create(ZkClient.java:304)
> > at org.I0Itec.zkclient.ZkClient.createPersistent(ZkClient.java:243)
> > at kafka.utils.ZkUtils$.createPersistentPath(ZkUtils.scala:306)
> > at kafka.admin.AdminUtils$.deleteTopic(AdminUtils.scala:159)
> > at kafka.admin.AdminUtils.deleteTopic(AdminUtils.scala)
> > at Test.deleteTopic(Test.java:98)
> > at Test.main(Test.java:76)
> > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException:
> > KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > at
> > org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
> > at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> > at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
> > at org.I0Itec.zkclient.ZkConnection.create(ZkConnection.java:87)
> > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:308)
> > at org.I0Itec.zkclient.ZkClient$1.call(ZkClient.java:304)
> > at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
> > ... 7 more
> >
> > *The corresponding zookeeper logs*:
> > [2015-07-16 15:31:14,383] INFO Accepted socket connection from /
> > 127.0.0.1:23363 (org.apache.zookeeper.server.NIOServerCnxnFactory)
> > [2015-07-16 15:31:14,385] INFO Client attempting to establish new session
> > at /127.0.0.1:23363 (org.apache.zookeeper.server.ZooKeeperServer)
> > [2015-07-16 15:31:14,391] INFO Established session 0x14e98d2ce98000c with
> > negotiated timeout 6000 for client /127.0.0.1:23363
> > (org.apache.zookeeper.server.ZooKeeperServer)
> > [2015-07-16 15:31:14,510] INFO Got user-level KeeperException when
> > processing sessionid:0x14e98d2ce98000c type:create cxid:0x1 zxid:0x963
> > txntype:-1 reqpath:n/a Error Path:/admin/delete_topics/testTopic17
> > Error:KeeperErrorCode = NodeExists for /admin/delete_topics/testTopic17
> > (org.apache.zookeeper.server.PrepRequestProcessor)
> > [2015-07-16 15:31:14,842] WARN caught end of stream exception
> > (org.apache.zookeeper.server.NIOServerCnxn)
> > EndOfStreamException: Unable to read additional data from client
> sessionid
> > 0x14e98d2ce98000c, likely client has closed socket
> > at
> > org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
> > at
> >
> >
> org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
> > at java.lang.Thread.run(Thread.java:744)
> > [2015-07-16 15:31:14,843] INFO Closed socket connection for client /
> > 127.0.0.1:23363 which had sessionid 0x14e98d2ce98000c
> > (org.apache.zookeeper.server.NIOServerCnxn)
> > [2015-07-16 15:31:21,000] INFO Expiring session 0x14e98d2ce98000c,
> timeout
> > of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
> > [2015-07-16 15:31:21,001] INFO Processed session termination for
> sessionid:
> > 0x14e98d2ce98000c (org.apache.zookeeper.server.PrepRequestProcessor)
> >
> > Could someone please let me know if I am missing anything?
> >
> > Thank you,
> > Siva.
> >
>
>
>
--
Regards,
Ashish