You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/05/11 09:53:01 UTC

[GitHub] [pulsar-client-go] cydrain opened a new issue #516: pulsar RACE issue

cydrain opened a new issue #516:
URL: https://github.com/apache/pulsar-client-go/issues/516


   I'm from Milvus team, we use Pulsar in our system.
   When I run unittest, I often see following pulsar RACE issue.
   Can you help to fix this?
   
   
   WARNING: DATA RACE
   Read at 0x00c00015de68 by goroutine 144:
     github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).internalClose()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:842 +0x5f1
     github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).runEventsLoop()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:801 +0x29b
   
   Previous write at 0x00c00015de68 by goroutine 208:
     github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).Decompress()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:1062 +0x468
     github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).MessageReceived()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:474 +0x104
     github.com/apache/pulsar-client-go/pulsar/internal.(*connection).handleMessage()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:638 +0x1ab
     github.com/apache/pulsar-client-go/pulsar/internal.(*connection).internalReceivedCommand()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:527 +0x472
     github.com/apache/pulsar-client-go/pulsar/internal.(*connection).run()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:381 +0x57c
     github.com/apache/pulsar-client-go/pulsar/internal.(*connection).start.func1()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:215 +0xc4
   
   Goroutine 144 (running) created at:
     github.com/apache/pulsar-client-go/pulsar.newPartitionConsumer()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:207 +0xf35
     github.com/apache/pulsar-client-go/pulsar.(*consumer).internalTopicSubscribeToPartitions.func1()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_impl.go:315 +0x778
   
   Goroutine 208 (running) created at:
     github.com/apache/pulsar-client-go/pulsar/internal.(*connection).start()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection.go:211 +0x4c
     github.com/apache/pulsar-client-go/pulsar/internal.(*connectionPool).GetConnection()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/connection_pool.go:100 +0x6de
     github.com/apache/pulsar-client-go/pulsar/internal.(*rpcClient).Request()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/internal/rpc_client.go:112 +0xed
     github.com/apache/pulsar-client-go/pulsar.(*partitionConsumer).grabConn()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:951 +0x15d1
     github.com/apache/pulsar-client-go/pulsar.newPartitionConsumer()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_partition.go:179 +0xc51
     github.com/apache/pulsar-client-go/pulsar.(*consumer).internalTopicSubscribeToPartitions.func1()
         /go/pkg/mod/github.com/apache/pulsar-client-go@v0.4.0/pulsar/consumer_impl.go:315 +0x778
   ==================
   time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39286" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39282->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39282" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39292" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39286->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39286" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39292->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39292" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39284" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Connection closed]" local_addr="172.18.0.5:39288" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39284->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39284" remote_addr="pulsar://pulsar:6650"
   time="2021-05-09T16:12:45Z" level=info msg="[Error reading from connection]" error="Short read when reading frame size: read tcp 172.18.0.5:39288->172.18.0.4:6650: use of closed network connection" local_addr="172.18.0.5:39288" remote_addr="pulsar://pulsar:6650"
   --- FAIL: TestAssignSegmentID (0.40s)
       testing.go:1042: race detected during execution of test
   FAIL
   coverage: 68.0% of statements
   FAIL	github.com/milvus-io/milvus/internal/dataservice	4.807s
   FAIL
   make: *** [test-go] Error 1
   Makefile:149: recipe for target 'test-go' failed
   2
   Error: Process completed with exit code 2.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar-client-go] cydrain commented on issue #516: pulsar RACE issue

Posted by GitBox <gi...@apache.org>.
cydrain commented on issue #516:
URL: https://github.com/apache/pulsar-client-go/issues/516#issuecomment-841115685


   Any update ?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar-client-go] wolfstudy commented on issue #516: pulsar RACE issue

Posted by GitBox <gi...@apache.org>.
wolfstudy commented on issue #516:
URL: https://github.com/apache/pulsar-client-go/issues/516#issuecomment-849452012


   > Any update ?
   
   Hello @cydrain Sorry for the late reply to this question. This looks like a bug, I will send a pull request to fix this problem later.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar-client-go] wolfstudy closed issue #516: pulsar RACE issue

Posted by GitBox <gi...@apache.org>.
wolfstudy closed issue #516:
URL: https://github.com/apache/pulsar-client-go/issues/516


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org