You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/04/25 04:55:34 UTC
[GitHub] [pulsar] zr-hebo opened a new issue #6815: Geo repeated consumption
zr-hebo opened a new issue #6815:
URL: https://github.com/apache/pulsar/issues/6815
**Describe the bug**
I deployed two pulsar clusters across regions, the RRT between two regions is 400ms, but each message produced is consumed twice in the same subscription.
**To Reproduce**
Steps to reproduce the behavior:
1. Produce message in one region
```
pulsar-client produce --messages "hahae" my-tenant/my-namespace/hello
```
2. consume message from the other region
```
pulsar-client consume my-tenant/my-namespace/hello --subscription-name haha --num-messages 0
```
3. See error
```
11:49:23.836 [pulsar-client-io-1-1] INFO com.scurrilous.circe.checksum.Crc32cIntChecksum - SSE4.2 CRC32C provider initialized
----- got message -----
hahae
----- got message -----
hahae
```
**Expected behavior**
I expect only one message
```
----- got message -----
hahae
```
**Desktop:**
- OS: Linux 3.10.0-1062.4.1.el7.x86_64
**Additional context**
configuration-store: apache-zookeeper-3.6.0
apache-pulsar-2.5.0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] zr-hebo commented on issue #6815: Geo repeated consumption
Posted by GitBox <gi...@apache.org>.
zr-hebo commented on issue #6815:
URL: https://github.com/apache/pulsar/issues/6815#issuecomment-619551417
set de-duplication solved this problem
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] zr-hebo commented on issue #6815: Geo repeated consumption
Posted by GitBox <gi...@apache.org>.
zr-hebo commented on issue #6815:
URL: https://github.com/apache/pulsar/issues/6815#issuecomment-619322036
Added some logs, IP desensitized
```
11:49:10.765 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xc838a204, L:/1.1.7.183:48176 - R:server_bz/1.1.7.183:6650]] Connected to server
11:49:11.720 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Starting Pulsar consumer status recorder with config: {
"topicNames" : [ "my-tenant/my-namespace/hydra" ],
"topicsPattern" : null,
"subscriptionName" : "haha",
"subscriptionType" : "Exclusive",
"receiverQueueSize" : 1000,
"acknowledgementsGroupTimeMicros" : 100000,
"negativeAckRedeliveryDelayMicros" : 60000000,
"maxTotalReceiverQueueSizeAcrossPartitions" : 50000,
"consumerName" : null,
"ackTimeoutMillis" : 0,
"tickDurationMillis" : 1000,
"priorityLevel" : 0,
"cryptoFailureAction" : "FAIL",
"properties" : { },
"readCompacted" : false,
"subscriptionInitialPosition" : "Latest",
"patternAutoDiscoveryPeriod" : 1,
"regexSubscriptionMode" : "PersistentOnly",
"deadLetterPolicy" : null,
"autoUpdatePartitions" : true,
"replicateSubscriptionState" : false,
"resetIncludeHead" : false,
"keySharedPolicy" : null
}
11:49:11.724 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - Pulsar client config: {
"serviceUrl" : "pulsar://server_bz:6650/",
"authPluginClassName" : null,
"authParams" : null,
"operationTimeoutMs" : 30000,
"statsIntervalSeconds" : 60,
"numIoThreads" : 1,
"numListenerThreads" : 1,
"connectionsPerBroker" : 1,
"useTcpNoDelay" : true,
"useTls" : false,
"tlsTrustCertsFilePath" : "",
"tlsAllowInsecureConnection" : false,
"tlsHostnameVerificationEnable" : false,
"concurrentLookupRequest" : 5000,
"maxLookupRequest" : 50000,
"maxNumberOfRejectedRequestPerConnection" : 50,
"keepAliveIntervalSeconds" : 30,
"connectionTimeoutMs" : 10000,
"requestTimeoutMs" : 60000,
"initialBackoffIntervalNanos" : 100000000,
"maxBackoffIntervalNanos" : 60000000000
}
11:49:15.075 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConnectionPool - [[id: 0xe122a512, L:/1.1.7.183:35566 - R:server_bj/1.50.11.15:6650]] Connected to server
11:49:15.947 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConsumerImpl - [my-tenant/my-namespace/hydra][haha] Subscribing to topic on cnx [id: 0xe122a512, L:/1.1.7.183:35566 - R:server_bj/1.50.11.15:6650]
11:49:16.420 [pulsar-client-io-1-1] INFO org.apache.pulsar.client.impl.ConsumerImpl - [my-tenant/my-namespace/hydra][haha] Subscribed to topic on server_bj/1.50.11.15:6650 -- consumer: 0
11:49:23.836 [pulsar-client-io-1-1] INFO com.scurrilous.circe.checksum.Crc32cIntChecksum - SSE4.2 CRC32C provider initialized
----- got message -----
hahae
----- got message -----
hahae
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org