You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/12/09 11:37:00 UTC

[GitHub] [pulsar] nodece opened a new issue #13211: [Pulsar 2.9.0] compact command does not work

nodece opened a new issue #13211:
URL: https://github.com/apache/pulsar/issues/13211


   **Describe the bug**
   
   When I call the `pulsarctl topics compact test-compact-topic` command, which cannot get a response from the pulsar.
   
   I check out this codebase, I found it doesn't work when receiving the request from the pulsarctl: https://github.com/apache/pulsar/blob/master/pulsar-metadata/src/main/java/org/apache/pulsar/metadata/impl/ZKMetadataStore.java#L148, the zk client is connected and active.
   
   **To Reproduce**
   ```
   docker run -itd \
     -p 6650:6650 \
     -p 8080:8080 \
    --name pulsar-2.9 \
     apachepulsar/pulsar:2.9.0 \
     bin/pulsar standalone
   
   pulsarctl topics compact test-compact-topic
   ```
   
   **Expected behavior**
   
   It is working.
   
   **Additional context**
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] nodece commented on issue #13211: [Pulsar 2.9.0] ZK callbacks are sometimes unresponsive

Posted by GitBox <gi...@apache.org>.
nodece commented on issue #13211:
URL: https://github.com/apache/pulsar/issues/13211#issuecomment-1015468082


   You are right, the following is thread log of callback process:
   ```
   "main-EventThread" prio=0 tid=0x0 nid=0x0 waiting on condition
        java.lang.Thread.State: WAITING
    on java.util.concurrent.CompletableFuture$Signaller@6b36f41b
   	at java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
   	at java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1796)
   	at java.base@11.0.12/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3128)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1823)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2043)
   	at app//org.apache.pulsar.broker.web.PulsarWebResource.validateTopicOwnership(PulsarWebResource.java:605)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.internalTriggerCompactionNonPartitionedTopic(PersistentTopicsBase.java:3627)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.lambda$internalTriggerCompaction$171(PersistentTopicsBase.java:3602)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase$$Lambda$930/0x00000008009f0440.accept(Unknown Source)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$UniAccept.tryFire$$$capture(CompletableFuture.java:714)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore.handleGetResult(ZKMetadataStore.java:227)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$batchOperation$6(ZKMetadataStore.java:177)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore$$Lambda$479/0x00000008006cb440.processResult(Unknown Source)
   	at app//org.apache.pulsar.metadata.impl.PulsarZooKeeperClient$3$1.processResult(PulsarZooKeeperClient.java:490)
   	at app//org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:722)
   	at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:563)
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] nodece edited a comment on issue #13211: [Pulsar 2.9.0] ZK callbacks are sometimes unresponsive

Posted by GitBox <gi...@apache.org>.
nodece edited a comment on issue #13211:
URL: https://github.com/apache/pulsar/issues/13211#issuecomment-1015468082


   @codelipenghui You are right, the following is thread log of callback process:
   ```
   "main-EventThread" prio=0 tid=0x0 nid=0x0 waiting on condition
        java.lang.Thread.State: WAITING
    on java.util.concurrent.CompletableFuture$Signaller@6b36f41b
   	at java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
   	at java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1796)
   	at java.base@11.0.12/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3128)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1823)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2043)
   	at app//org.apache.pulsar.broker.web.PulsarWebResource.validateTopicOwnership(PulsarWebResource.java:605)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.internalTriggerCompactionNonPartitionedTopic(PersistentTopicsBase.java:3627)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.lambda$internalTriggerCompaction$171(PersistentTopicsBase.java:3602)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase$$Lambda$930/0x00000008009f0440.accept(Unknown Source)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$UniAccept.tryFire$$$capture(CompletableFuture.java:714)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore.handleGetResult(ZKMetadataStore.java:227)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$batchOperation$6(ZKMetadataStore.java:177)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore$$Lambda$479/0x00000008006cb440.processResult(Unknown Source)
   	at app//org.apache.pulsar.metadata.impl.PulsarZooKeeperClient$3$1.processResult(PulsarZooKeeperClient.java:490)
   	at app//org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:722)
   	at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:563)
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] codelipenghui closed issue #13211: [Pulsar 2.9.0] ZK callbacks are sometimes unresponsive

Posted by GitBox <gi...@apache.org>.
codelipenghui closed issue #13211:
URL: https://github.com/apache/pulsar/issues/13211


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] nodece edited a comment on issue #13211: [Pulsar 2.9.0] ZK callbacks are sometimes unresponsive

Posted by GitBox <gi...@apache.org>.
nodece edited a comment on issue #13211:
URL: https://github.com/apache/pulsar/issues/13211#issuecomment-1015468082


   @codelipenghui You are right, the following is thread log of callback process:
   ```
   "main-EventThread" prio=0 tid=0x0 nid=0x0 waiting on condition
        java.lang.Thread.State: WAITING
    on java.util.concurrent.CompletableFuture$Signaller@6b36f41b
   	at java.base@11.0.12/jdk.internal.misc.Unsafe.park(Native Method)
   	at java.base@11.0.12/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$Signaller.block(CompletableFuture.java:1796)
   	at java.base@11.0.12/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3128)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.waitingGet(CompletableFuture.java:1823)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.join(CompletableFuture.java:2043)
   	at app//org.apache.pulsar.broker.web.PulsarWebResource.validateTopicOwnership(PulsarWebResource.java:605)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.internalTriggerCompactionNonPartitionedTopic(PersistentTopicsBase.java:3627)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase.lambda$internalTriggerCompaction$171(PersistentTopicsBase.java:3602)
   	at app//org.apache.pulsar.broker.admin.impl.PersistentTopicsBase$$Lambda$930/0x00000008009f0440.accept(Unknown Source)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$UniAccept.tryFire$$$capture(CompletableFuture.java:714)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture$UniAccept.tryFire(CompletableFuture.java)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:506)
   	at java.base@11.0.12/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2073)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore.handleGetResult(ZKMetadataStore.java:227)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore.lambda$batchOperation$6(ZKMetadataStore.java:177)
   	at app//org.apache.pulsar.metadata.impl.ZKMetadataStore$$Lambda$479/0x00000008006cb440.processResult(Unknown Source)
   	at app//org.apache.pulsar.metadata.impl.PulsarZooKeeperClient$3$1.processResult(PulsarZooKeeperClient.java:490)
   	at app//org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:722)
   	at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:563)
   ```
   I submitted #13809 to fix this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] nodece commented on issue #13211: [Pulsar 2.9.0] ZK callbacks are sometimes unresponsive

Posted by GitBox <gi...@apache.org>.
nodece commented on issue #13211:
URL: https://github.com/apache/pulsar/issues/13211#issuecomment-1014629615


   I will work on this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] codelipenghui commented on issue #13211: [Pulsar 2.9.0] ZK callbacks are sometimes unresponsive

Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #13211:
URL: https://github.com/apache/pulsar/issues/13211#issuecomment-1015373189


   @nodece Can you share the jstack? looks like a deadlock in the zk callback process?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org