You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by "mukesh154 (via GitHub)" <gi...@apache.org> on 2024/04/10 08:32:30 UTC

[I] [Bug] Partitioned topic deletion by topic GC [pulsar]

mukesh154 opened a new issue, #22471:
URL: https://github.com/apache/pulsar/issues/22471

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.
   
   
   ### Read release policy
   
   - [X] I understand that unsupported versions don't get bug fixes. I will attempt to reproduce the issue on a supported version of Pulsar client and Pulsar broker.
   
   
   ### Version
   
   3.1.2
   
   ### Minimal reproduce step
   
   - Fire up a Pulsar cluster with the "inactive delete" options enabled:
   
   ```
   brokerDeleteInactiveTopicsEnabled=true
   brokerDeleteInactiveTopicsFrequencySeconds=60
   brokerDeleteInactiveTopicsMode=delete_when_no_subscriptions
   brokerDeleteInactiveTopicsMaxInactiveDurationSeconds=600
   subscriptionExpirationTimeMinutes=10
   subscriptionExpiryCheckIntervalInMinutes=1
   ttlDurationDefaultInSeconds=600
   ```
   
   - Create a namespace with inactive topic policy deleted after 60 seconds. This is a default behaviour.
   
   - Create a partitioned topic via pulsar-admin
   
   - Produce a few messages to the partitioned topic. Do not create any subscription
   
   - Check after a few minutes to make sure if the partitions are deleted or not and check the partitioned topic self still there or not.
   
   ### What did you expect to see?
   
   The topic should be deleted along with the partitions because they weren't being used.
   
   ### What did you see instead?
   
   The topic is never cleaned up only partitions are deleted. If you list the topics with the pulsar-admin tool the topic won't be listed, but when you try to create another topic with the same name it will say topic already exists.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] Partitioned topic deletion by topic GC [pulsar]

Posted by "dao-jun (via GitHub)" <gi...@apache.org>.
dao-jun commented on issue #22471:
URL: https://github.com/apache/pulsar/issues/22471#issuecomment-2056457310

   it seems not a bug, please see ServiceConfiguration#brokerDeleteInactivePartitionedTopicMetadataEnabled


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] Partitioned topic deletion by topic GC [pulsar]

Posted by "zzzming (via GitHub)" <gi...@apache.org>.
zzzming commented on issue #22471:
URL: https://github.com/apache/pulsar/issues/22471#issuecomment-2057702631

   May not be a bug. Check the broker.conf, this should be true but the default is false.
   ```
   # Metadata of inactive partitioned topic will not be cleaned up automatically by default.
   # Note: If `allowAutoTopicCreation` and this option are enabled at the same time,
   # it may appear that a partitioned topic has just been deleted but is automatically created as a non-partitioned topic.
   brokerDeleteInactivePartitionedTopicMetadataEnabled=false
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] [Bug] Partitioned topic deletion by topic GC [pulsar]

Posted by "mukesh154 (via GitHub)" <gi...@apache.org>.
mukesh154 commented on issue #22471:
URL: https://github.com/apache/pulsar/issues/22471#issuecomment-2058257488

   It seems to be working with enabling the flag on `broker.conf`:
   `brokerDeleteInactivePartitionedTopicMetadataEnabled=true`
   
   The same flag is not there on `standalone.conf` and on adding manually, it is not working as expected.
   So, it only works with docker & k8s deployments not on standalone.
   
   Thanks @dao-jun @zzzming 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org