You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/09/13 06:29:02 UTC

[GitHub] [pulsar] xuesongxs opened a new issue #12021: Send to retry letter topic exception with topic

xuesongxs opened a new issue #12021:
URL: https://github.com/apache/pulsar/issues/12021


   **Describe the bug**
   Pulsar v2.6.2
   
   ```
   org.apache.pulsar.client.api.PulsarClientException$InvalidMessageException: null
   	at org.apache.pulsar.client.impl.ConsumerBase.reconsumeLaterAsync(ConsumerBase.java:380) ~[pulsar-client-2.6.2.jar:2.6.2]
   	at org.apache.pulsar.client.impl.ConsumerBase.reconsumeLater(ConsumerBase.java:306) ~[pulsar-client-2.6.2.jar:2.6.2]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.bean.PulsarClientFactory.reconsumeLater(PulsarClientFactory.java:102) ~[housekeeping-1.0.0.jar:1.0.0]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.threads.MessageResource.igniteConsumerMessage(MessageResource.java:188) [housekeeping-1.0.0.jar:1.0.0]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.threads.MessageResource.dealMessage(MessageResource.java:63) [housekeeping-1.0.0.jar:1.0.0]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.threads.MessageProvider.run(MessageProvider.java:25) [housekeeping-1.0.0.jar:1.0.0]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_151]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151]
   	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151]
   
   2021-09-12 13:02:23.472 ERROR 107874 --- [ekeeping-pool-7] o.a.pulsar.client.impl.ConsumerImpl      : Send to retry letter topic exception with topic: persistent://pulsar/iagw/21_TX_IGN_DLQ, messageId: 8281593:4196:9
   
   org.apache.pulsar.client.api.PulsarClientException$TimeoutException: The producer pulsar_jp-35-43945 can not send message to the topic persistent://pulsar/iagw/21_TX_IGN_RETRY-partition-7 within given timeout
   	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:856) ~[pulsar-client-api-2.6.2.jar:2.6.2]
   	at org.apache.pulsar.client.impl.ProducerBase.send(ProducerBase.java:117) ~[pulsar-client-2.6.2.jar:2.6.2]
   	at org.apache.pulsar.client.impl.TypedMessageBuilderImpl.send(TypedMessageBuilderImpl.java:89) ~[pulsar-client-2.6.2.jar:2.6.2]
   	at org.apache.pulsar.client.impl.ConsumerImpl.doReconsumeLater(ConsumerImpl.java:671) ~[pulsar-client-2.6.2.jar:2.6.2]
   	at org.apache.pulsar.client.impl.MultiTopicsConsumerImpl.doReconsumeLater(MultiTopicsConsumerImpl.java:456) [pulsar-client-2.6.2.jar:2.6.2]
   	at org.apache.pulsar.client.impl.ConsumerBase.reconsumeLaterAsync(ConsumerBase.java:378) [pulsar-client-2.6.2.jar:2.6.2]
   	at org.apache.pulsar.client.impl.ConsumerBase.reconsumeLater(ConsumerBase.java:306) [pulsar-client-2.6.2.jar:2.6.2]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.bean.PulsarClientFactory.reconsumeLater(PulsarClientFactory.java:102) [housekeeping-1.0.0.jar:1.0.0]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.threads.MessageResource.igniteConsumerMessage(MessageResource.java:188) [housekeeping-1.0.0.jar:1.0.0]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.threads.MessageResource.dealMessage(MessageResource.java:63) [housekeeping-1.0.0.jar:1.0.0]
   	at com.newland.boss.nlstreamboss.application.server.housekeeping.threads.MessageProvider.run(MessageProvider.java:25) [housekeeping-1.0.0.jar:1.0.0]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [na:1.8.0_151]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_151]
   	at java.lang.Thread.run(Thread.java:748) [na:1.8.0_151]
   ```
   Topic Storage Size Cannot release.
   ![image](https://user-images.githubusercontent.com/54351417/133034107-d96202f7-e1e6-45fd-8a75-a95178aeca11.png)
   
   **To Reproduce**
   Steps to reproduce the behavior:
   1.create consumer.
   ```
                       String[] topic = topicTmp.split("&");
                       Consumer<NlMessage> consumer = pulsarClient.newConsumer(Schema.JSON(NlMessage.class))
                               .topic(topic[0])
                               .enableRetry(true)
                               .deadLetterPolicy(DeadLetterPolicy.builder()
                                       // 注意这里使用公用的重试和死信队列
                                       .retryLetterTopic(pulsarConfig.getRetryTopic())
                                       .maxRedeliverCount(pulsarConfig.getMaxDeliveryCount())
                                       .deadLetterTopic(pulsarConfig.getDeadLetterTopic())
                                       .build())
                               .subscriptionName(pulsarConfig.getSubscription())
                               .subscriptionType(SubscriptionType.Shared)
                               .subscriptionInitialPosition(SubscriptionInitialPosition.Earliest)
                               .ackTimeout(0, TimeUnit.SECONDS)
                               .subscribe();
   ```
   2.10 threads share a consumer to receive messages.
   3.If the message processing fails, call the recommerlater interface.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] liangyuanpeng commented on issue #12021: Send to retry letter topic exception with topic

Posted by GitBox <gi...@apache.org>.
liangyuanpeng commented on issue #12021:
URL: https://github.com/apache/pulsar/issues/12021#issuecomment-919844009


   Could you try pulsar 2.8.x for this?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] github-actions[bot] commented on issue #12021: Send to retry letter topic exception with topic

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #12021:
URL: https://github.com/apache/pulsar/issues/12021#issuecomment-1056055844


   The issue had no activity for 30 days, mark with Stale label.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org