You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2019/07/22 11:57:56 UTC
[GitHub] [pulsar] zhangbitao opened a new issue #4777: Can't limits
consumer's rate using command "set-subscription-dispatch-rate"
zhangbitao opened a new issue #4777: Can't limits consumer's rate using command "set-subscription-dispatch-rate"
URL: https://github.com/apache/pulsar/issues/4777
**Describe the bug**
Can't limits consumer's rate using command "set-subscription-dispatch-rate"
**To Reproduce**
1. Set subscription message-dispatch-rate
```
# bin/pulsar-admin namespaces set-subscription-dispatch-rate public/default --msg-dispatch-rate 10 --dispatch-rate-period 1
{
"dispatchThrottlingRateInMsg" : 10,
"dispatchThrottlingRateInByte" : -1,
"ratePeriodInSecond" : 1
}
```
2. case 1: Set Batching=true in pulsar.ProducerOptions, but the result doesn't I want
```
producer, err := client.CreateProducer(pulsar.ProducerOptions{
Topic: test-topic-1,
Batching: true,
BlockIfQueueFull: true,
SendTimeout: 10,
MaxPendingMessages: 10000,
})
```
```
# ./pulsar-admin topics stats persistent://public/default/test-topic-1
{
"msgRateIn" : 0.0,
"msgThroughputIn" : 0.0,
"msgRateOut" : 583.2003004842348,
"msgThroughputOut" : 616088.1840958354,
"averageMsgSize" : 0.0,
"storageSize" : 1849634,
"publishers" : [ ],
"subscriptions" : {
"test-1" : {
"msgRateOut" : 583.2003004842348,
"msgThroughputOut" : 616088.1840958354,
"msgRateRedeliver" : 0.0,
"msgBacklog" : 14,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "Exclusive",
"activeConsumerName" : "145283",
"msgRateExpired" : 0.0,
"consumers" : [ {
"msgRateOut" : 583.2003004842348,
"msgThroughputOut" : 616088.1840958354,
"msgRateRedeliver" : 0.0,
"consumerName" : "145283",
"availablePermits" : -955,
"unackedMessages" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"metadata" : { },
"address" : "/10.111.4.158:29127",
"connectedSince" : "2019-07-22T19:32:24.877+08:00",
"clientVersion" : "2.3.1"
} ],
"isReplicated" : false
}
},
"replication" : { },
"deduplicationStatus" : "Disabled"
}
```
3. case 2: Set Batching=false in pulsar.ProducerOptions, but the result doesn't I want
```
producer, err := client.CreateProducer(pulsar.ProducerOptions{
Topic: test-topic-1,
Batching: false,
BlockIfQueueFull: true,
SendTimeout: 10,
MaxPendingMessages: 10000,
})
```
```
./pulsar-admin topics stats persistent://public/default/test-topic-1
{
"msgRateIn" : 0.0,
"msgThroughputIn" : 0.0,
"msgRateOut" : 50.14999267057858,
"msgThroughputOut" : 52904.95893460692,
"averageMsgSize" : 0.0,
"storageSize" : 7004225,
"publishers" : [ ],
"subscriptions" : {
"test-1" : {
"msgRateOut" : 50.14999267057858,
"msgThroughputOut" : 52904.95893460692,
"msgRateRedeliver" : 0.0,
"msgBacklog" : 53,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "Exclusive",
"activeConsumerName" : "145283",
"msgRateExpired" : 0.0,
"consumers" : [ {
"msgRateOut" : 50.14999267057858,
"msgThroughputOut" : 52904.95893460692,
"msgRateRedeliver" : 0.0,
"consumerName" : "145283",
"availablePermits" : -917,
"unackedMessages" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"metadata" : { },
"address" : "/10.111.4.158:29127",
"connectedSince" : "2019-07-22T19:32:24.877+08:00",
"clientVersion" : "2.3.1"
} ],
"isReplicated" : false
}
},
"replication" : { },
"deduplicationStatus" : "Disabled"
}
```
4. case 3: Set Batching=true and BatchingMaxMessages=2 in pulsar.ProducerOptions, but the result doesn't I want
```
producer, err := client.CreateProducer(pulsar.ProducerOptions{
Topic: test-topic-1,
Batching: true,
BlockIfQueueFull: true,
SendTimeout: 10,
MaxPendingMessages: 10000,
BatchingMaxMessages: 2,
})
```
```
# ./pulsar-admin topics stats persistent://public/default/test-topic-1
{
"msgRateIn" : 0.0,
"msgThroughputIn" : 0.0,
"msgRateOut" : 19.983333794948344,
"msgThroughputOut" : 21562.417164758503,
"averageMsgSize" : 0.0,
"storageSize" : 51715374,
"publishers" : [ ],
"subscriptions" : {
"test-1" : {
"msgRateOut" : 19.983333794948344,
"msgThroughputOut" : 21562.417164758503,
"msgRateRedeliver" : 0.0,
"msgBacklog" : 1351,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "Exclusive",
"activeConsumerName" : "145283",
"msgRateExpired" : 0.0,
"consumers" : [ {
"msgRateOut" : 19.983333794948344,
"msgThroughputOut" : 21562.417164758503,
"msgRateRedeliver" : 0.0,
"consumerName" : "145283",
"availablePermits" : 708,
"unackedMessages" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"metadata" : { },
"address" : "/10.111.4.158:29127",
"connectedSince" : "2019-07-22T19:32:24.877+08:00",
"clientVersion" : "2.3.1"
} ],
"isReplicated" : false
}
},
"replication" : { },
"deduplicationStatus" : "Disabled"
}
```
**Expected behavior**
"msgRateOut" is about 10.0
**Desktop (please complete the following information):**
- OS: Linux x86_64 GNU/Linux
- Producer: pulsar-2.4.0
- Consumer: pulsar-2.3.1
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services