You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/09/09 04:34:18 UTC
[GitHub] [pulsar] jerrypeng opened a new issue #11979: Topic stats "unackedMessages" not updated correctly for subscription and consumer
jerrypeng opened a new issue #11979:
URL: https://github.com/apache/pulsar/issues/11979
**Describe the bug**
The "unackedMessages" stat is not updated correctly when getting topic stats via "pulsar-admin topics stats <TOPIC_NAME>"
For example
```
{
"msgRateIn" : 0.0,
"msgThroughputIn" : 0.0,
"msgRateOut" : 23.73729424962721,
"msgThroughputOut" : 1343.9106512368942,
"bytesInCounter" : 226464,
"msgInCounter" : 4000,
"bytesOutCounter" : 226464,
"msgOutCounter" : 4000,
"averageMsgSize" : 0.0,
"msgChunkPublished" : false,
"storageSize" : 226464,
"backlogSize" : 226464,
"offloadedStorageSize" : 0,
"lastOffloadLedgerId" : 0,
"lastOffloadSuccessTimeStamp" : 0,
"lastOffloadFailureTimeStamp" : 0,
"publishers" : [ ],
"waitingPublishers" : 0,
"subscriptions" : {
"foo" : {
"msgRateOut" : 23.73729424962721,
"msgThroughputOut" : 1343.9106512368942,
"bytesOutCounter" : 226464,
"msgOutCounter" : 4000,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0,
"msgBacklog" : 4000,
"backlogSize" : 226464,
"msgBacklogNoDelayed" : 4000,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "Exclusive",
"activeConsumerName" : "4736f",
"msgRateExpired" : 0.0,
"totalMsgExpired" : 0,
"lastExpireTimestamp" : 0,
"lastConsumedFlowTimestamp" : 1631161834268,
"lastConsumedTimestamp" : 1631161834267,
"lastAckedTimestamp" : 0,
"lastMarkDeleteAdvancedTimestamp" : 0,
"consumers" : [ {
"msgRateOut" : 23.73729424962721,
"msgThroughputOut" : 1343.9106512368942,
"bytesOutCounter" : 226464,
"msgOutCounter" : 4000,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "4736f",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 6,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 1631161834267,
"metadata" : { },
"address" : "/127.0.0.1:59606",
"connectedSince" : "2021-09-08T21:29:16.338-07:00",
"clientVersion" : "2.9.0-SNAPSHOT"
} ],
"isDurable" : true,
"isReplicated" : false,
"consumersAfterMarkDeletePosition" : { },
"nonContiguousDeletedMessagesRanges" : 0,
"nonContiguousDeletedMessagesRangesSerializedSize" : 0,
"durable" : true,
"replicated" : false
}
},
"replication" : { },
"deduplicationStatus" : "Disabled",
"nonContiguousDeletedMessagesRanges" : 0,
"nonContiguousDeletedMessagesRangesSerializedSize" : 0
}
```
**To Reproduce**
1. Start Pulsar standalone cluster
2. Create a consumer that reads from a topic but does not ack any messages
3. Start producing messages to the topic
4. Get stats of the topic.
**Expected behavior**
The "unackedMessages" stat is correctly displays the number of unacked messages for a subscription and consumer.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] github-actions[bot] commented on issue #11979: Topic stats "unackedMessages" not updated correctly for subscription and consumer
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #11979:
URL: https://github.com/apache/pulsar/issues/11979#issuecomment-1057583482
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] shibd commented on issue #11979: Topic stats "unackedMessages" not updated correctly for subscription and consumer
Posted by GitBox <gi...@apache.org>.
shibd commented on issue #11979:
URL: https://github.com/apache/pulsar/issues/11979#issuecomment-917815291
Currently, `unackedMessages` operates under the following scene:
1. Consumer use `Shard model` (SubscriptionType eq Shared / Key_Shared)
2. Consumer use `Individual ack`(consumer.acknowledge())
I try support all scene. But I found that this will have a great impact on the previous design.
I think we can discuss it clearly before we start.
Can be understand by PR: https://github.com/shibd/pulsar/pull/1/files
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] shibd commented on issue #11979: Topic stats "unackedMessages" not updated correctly for subscription and consumer
Posted by GitBox <gi...@apache.org>.
shibd commented on issue #11979:
URL: https://github.com/apache/pulsar/issues/11979#issuecomment-916691874
I repeated the bug, I'll try to fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] shibd edited a comment on issue #11979: Topic stats "unackedMessages" not updated correctly for subscription and consumer
Posted by GitBox <gi...@apache.org>.
shibd edited a comment on issue #11979:
URL: https://github.com/apache/pulsar/issues/11979#issuecomment-917815291
Currently, `unackedMessages` operates under the following scene:
1. Consumer use `Shard model` (SubscriptionType eq Shared / Key_Shared)
2. Consumer use `Individual ack`(consumer.acknowledge())
I try support all scene. But I found that this will have a great impact on the previous design. I think we can discuss it clearly.
Can be understand by PR: https://github.com/shibd/pulsar/pull/1/files
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] shibd removed a comment on issue #11979: Topic stats "unackedMessages" not updated correctly for subscription and consumer
Posted by GitBox <gi...@apache.org>.
shibd removed a comment on issue #11979:
URL: https://github.com/apache/pulsar/issues/11979#issuecomment-916691874
I repeated the bug, I'll try to fix it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org