You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@qpid.apache.org by "Jiri Daněk (Jira)" <ji...@apache.org> on 2021/05/26 13:52:00 UTC

[jira] [Commented] (DISPATCH-2152) Two races reported from new_qdr_connection_info_t in system_tests_distribution

    [ https://issues.apache.org/jira/browse/DISPATCH-2152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351800#comment-17351800 ] 

Jiri Daněk commented on DISPATCH-2152:
--------------------------------------

It looks like the problem is qd_alloc, so I will place suppression for that.

https://github.com/apache/qpid-dispatch/runs/2675448558?check_suite_focus=true#step:25:1914

{noformat}
49: E           ==================
49: E           WARNING: ThreadSanitizer: data race (pid=3666)
49: E             Atomic read of size 1 at 0x7b1000002b80 by thread T3:
49: E               #0 pthread_mutex_lock <null> (libtsan.so.0+0x5048a)
49: E               #1 sys_mutex_lock /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:57 (libqpid-dispatch.so+0x9607d)
49: E               #2 qd_alloc /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:335 (libqpid-dispatch.so+0x5c372)
49: E               #3 new_qd_session_t /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:108 (libqpid-dispatch.so+0x70de1)
49: E               #4 qd_session /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:1165 (libqpid-dispatch.so+0x73414)
49: E               #5 qd_container_handle_event /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:541 (libqpid-dispatch.so+0x742a4)
49: E               #6 handle /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1096 (libqpid-dispatch.so+0xf1241)
49: E               #7 thread_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1121 (libqpid-dispatch.so+0xf55fb)
49: E               #8 _thread_init /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:172 (libqpid-dispatch.so+0x95fa2)
49: E           
49: E             Previous write of size 8 at 0x7b1000002b80 by thread T2:
49: E               [failed to restore the stack]
49: E           
49: E             Location is heap block of size 64 at 0x7b1000002b80 allocated by thread T2:
49: E               #0 posix_memalign <null> (libtsan.so.0+0x32a23)
49: E               #1 sys_mutex /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:41 (libqpid-dispatch.so+0x95fe5)
49: E               #2 qd_alloc_init /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:291 (libqpid-dispatch.so+0x5c674)
49: E               #3 qd_alloc /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:325 (libqpid-dispatch.so+0x5c674)
49: E               #4 new_qd_session_t /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:108 (libqpid-dispatch.so+0x70de1)
49: E               #5 qd_session /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:1165 (libqpid-dispatch.so+0x73414)
49: E               #6 qd_link /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:950 (libqpid-dispatch.so+0x73707)
49: E               #7 CORE_link_first_attach /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:1698 (libqpid-dispatch.so+0xe9919)
49: E               #8 qdr_connection_process /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/connections.c:351 (libqpid-dispatch.so+0xa749c)
49: E               #9 AMQP_writable_conn_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:299 (libqpid-dispatch.so+0xe8c2d)
49: E               #10 writable_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:395 (libqpid-dispatch.so+0x74164)
49: E               #11 qd_container_handle_event /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:747 (libqpid-dispatch.so+0x74164)
49: E               #12 handle /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1096 (libqpid-dispatch.so+0xf1241)
49: E               #13 thread_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1121 (libqpid-dispatch.so+0xf5680)
49: E               #14 _thread_init /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:172 (libqpid-dispatch.so+0x95fa2)
49: E           
49: E             Thread T3 (tid=3670, running) created by main thread at:
49: E               #0 pthread_create <null> (libtsan.so.0+0x5bf45)
49: E               #1 sys_thread /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:181 (libqpid-dispatch.so+0x9643e)
49: E               #2 qd_server_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1499 (libqpid-dispatch.so+0xf5932)
49: E               #3 main_process /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:115 (qdrouterd+0x40287c)
49: E               #4 main /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:369 (qdrouterd+0x4024fc)
49: E           
49: E             Thread T2 (tid=3669, running) created by main thread at:
49: E               #0 pthread_create <null> (libtsan.so.0+0x5bf45)
49: E               #1 sys_thread /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:181 (libqpid-dispatch.so+0x9643e)
49: E               #2 qd_server_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1499 (libqpid-dispatch.so+0xf5932)
49: E               #3 main_process /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:115 (qdrouterd+0x40287c)
49: E               #4 main /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:369 (qdrouterd+0x4024fc)
49: E           
49: E           SUMMARY: ThreadSanitizer: data race (/lib64/libtsan.so.0+0x5048a) in __interceptor_pthread_mutex_lock
49: E           ==================
49: E           ThreadSanitizer: reported 1 warnings
49: E           <<<<
49: 
49: /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/tests/system_test.py:808: RuntimeError
49: =============================== warnings summary ===============================
49: ../../../../../../home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/tests/system_test.py:1317
49:   /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/tests/system_test.py:1317: PytestCollectionWarning: cannot collect test class 'TestTimeout' because it has a __init__ constructor (from: )
49:     class TestTimeout(object):
49: 
49: -- Docs: https://docs.pytest.org/en/stable/warnings.html
49: - generated xml file: /__w/qpid-dispatch/qpid-dispatch/qpid-dispatch/build/tests/junitxmls/system_tests_delivery_counts.xml -
49: =========================== short test summary info ============================
49: ERROR ::TwoRouterIngressEgressTest::test_two_router_large_message_ingress_egress_counts
49: =================== 27 passed, 1 warning, 1 error in 53.55s ====================
26/36 Test #49: system_tests_delivery_counts ............***Failed   53.82 sec
{noformat}

> Two races reported from new_qdr_connection_info_t in system_tests_distribution
> ------------------------------------------------------------------------------
>
>                 Key: DISPATCH-2152
>                 URL: https://issues.apache.org/jira/browse/DISPATCH-2152
>             Project: Qpid Dispatch
>          Issue Type: Bug
>    Affects Versions: 1.17.0
>            Reporter: Jiri Daněk
>            Priority: Major
>              Labels: race-condition, tsan
>
> https://github.com/apache/qpid-dispatch/pull/1231/checks?check_run_id=2640447633#step:25:1169
> {noformat}
> 37: WARNING: ThreadSanitizer: data race (pid=3272)
> 37:   Read of size 8 at 0x7fcf4f3c5810 by thread T4:
> 37:     #0 qd_alloc /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:335 (libqpid-dispatch.so+0x5c369)
> 37:     #1 new_qdr_connection_info_t /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core.c:42 (libqpid-dispatch.so+0xc6701)
> 37:     #2 qdr_connection_info /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/connections.c:182 (libqpid-dispatch.so+0xa6b6c)
> 37:     #3 AMQP_opened_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:1362 (libqpid-dispatch.so+0xeba54)
> 37:     #4 AMQP_outbound_opened_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:1564 (libqpid-dispatch.so+0xec9f3)
> 37:     #5 notify_opened /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:277 (libqpid-dispatch.so+0x71413)
> 37:     #6 policy_notify_opened /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:288 (libqpid-dispatch.so+0x71413)
> 37:     #7 qd_policy_amqp_open_connector /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/policy.c:1373 (libqpid-dispatch.so+0x91bf2)
> 37:     #8 qd_container_handle_event /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:515 (libqpid-dispatch.so+0x7433c)
> 37:     #9 handle /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1096 (libqpid-dispatch.so+0xf10f1)
> 37:     #10 thread_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1121 (libqpid-dispatch.so+0xf5530)
> 37:     #11 _thread_init /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:172 (libqpid-dispatch.so+0x95fa2)
> 37: 
> 37:   Previous write of size 8 at 0x7fcf4f3c5810 by main thread:
> 37:     [failed to restore the stack]
> 37: 
> 37:   Location is global '__desc_qdr_connection_info_t' of size 192 at 0x7fcf4f3c57c0 (libqpid-dispatch.so+0x000000136810)
> 37: 
> 37:   Thread T4 (tid=3277, running) created by main thread at:
> 37:     #0 pthread_create <null> (libtsan.so.0+0x5bf45)
> 37:     #1 sys_thread /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:181 (libqpid-dispatch.so+0x9643e)
> 37:     #2 qd_server_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1499 (libqpid-dispatch.so+0xf57e2)
> 37:     #3 main_process /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:115 (qdrouterd+0x40287c)
> 37:     #4 main /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:369 (qdrouterd+0x4024fc)
> 37: 
> 37: SUMMARY: ThreadSanitizer: data race /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:335 in qd_alloc
> 37: ==================
> {noformat}
> {noformat}
> 37: ==================
> 37: WARNING: ThreadSanitizer: data race (pid=3272)
> 37:   Atomic read of size 1 at 0x7b1000001c80 by thread T4:
> 37:     #0 pthread_mutex_lock <null> (libtsan.so.0+0x5048a)
> 37:     #1 sys_mutex_lock /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:57 (libqpid-dispatch.so+0x9607d)
> 37:     #2 qd_alloc /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:335 (libqpid-dispatch.so+0x5c372)
> 37:     #3 new_qdr_connection_info_t /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core.c:42 (libqpid-dispatch.so+0xc6701)
> 37:     #4 qdr_connection_info /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/connections.c:182 (libqpid-dispatch.so+0xa6b6c)
> 37:     #5 AMQP_opened_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:1362 (libqpid-dispatch.so+0xeba54)
> 37:     #6 AMQP_outbound_opened_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:1564 (libqpid-dispatch.so+0xec9f3)
> 37:     #7 notify_opened /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:277 (libqpid-dispatch.so+0x71413)
> 37:     #8 policy_notify_opened /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:288 (libqpid-dispatch.so+0x71413)
> 37:     #9 qd_policy_amqp_open_connector /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/policy.c:1373 (libqpid-dispatch.so+0x91bf2)
> 37:     #10 qd_container_handle_event /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:515 (libqpid-dispatch.so+0x7433c)
> 37:     #11 handle /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1096 (libqpid-dispatch.so+0xf10f1)
> 37:     #12 thread_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1121 (libqpid-dispatch.so+0xf5530)
> 37:     #13 _thread_init /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:172 (libqpid-dispatch.so+0x95fa2)
> 37: 
> 37:   Previous write of size 8 at 0x7b1000001c80 by main thread:
> 37:     [failed to restore the stack]
> 37: 
> 37:   Location is heap block of size 64 at 0x7b1000001c80 allocated by main thread:
> 37:     #0 posix_memalign <null> (libtsan.so.0+0x32a23)
> 37:     #1 sys_mutex /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:41 (libqpid-dispatch.so+0x95fe5)
> 37:     #2 qd_alloc_init /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:291 (libqpid-dispatch.so+0x5c674)
> 37:     #3 qd_alloc /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/alloc_pool.c:325 (libqpid-dispatch.so+0x5c674)
> 37:     #4 new_qdr_connection_info_t /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/router_core.c:42 (libqpid-dispatch.so+0xc6701)
> 37:     #5 qdr_connection_info /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_core/connections.c:182 (libqpid-dispatch.so+0xa6b6c)
> 37:     #6 AMQP_opened_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:1362 (libqpid-dispatch.so+0xeba54)
> 37:     #7 AMQP_outbound_opened_handler /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/router_node.c:1564 (libqpid-dispatch.so+0xec9f3)
> 37:     #8 notify_opened /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:277 (libqpid-dispatch.so+0x71413)
> 37:     #9 policy_notify_opened /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:288 (libqpid-dispatch.so+0x71413)
> 37:     #10 qd_policy_amqp_open_connector /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/policy.c:1373 (libqpid-dispatch.so+0x91bf2)
> 37:     #11 qd_container_handle_event /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/container.c:515 (libqpid-dispatch.so+0x7433c)
> 37:     #12 handle /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1096 (libqpid-dispatch.so+0xf10f1)
> 37:     #13 thread_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1121 (libqpid-dispatch.so+0xf5530)
> 37:     #14 qd_server_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1501 (libqpid-dispatch.so+0xf5808)
> 37:     #15 main_process /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:115 (qdrouterd+0x40287c)
> 37:     #16 main /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:369 (qdrouterd+0x4024fc)
> 37: 
> 37:   Thread T4 (tid=3277, running) created by main thread at:
> 37:     #0 pthread_create <null> (libtsan.so.0+0x5bf45)
> 37:     #1 sys_thread /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/posix/threading.c:181 (libqpid-dispatch.so+0x9643e)
> 37:     #2 qd_server_run /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/src/server.c:1499 (libqpid-dispatch.so+0xf57e2)
> 37:     #3 main_process /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:115 (qdrouterd+0x40287c)
> 37:     #4 main /home/runner/work/qpid-dispatch/qpid-dispatch/qpid-dispatch/router/src/main.c:369 (qdrouterd+0x4024fc)
> 37: 
> 37: SUMMARY: ThreadSanitizer: data race (/lib64/libtsan.so.0+0x5048a) in __interceptor_pthread_mutex_lock
> 37: ==================
> 37: ThreadSanitizer: reported 2 warnings
> {noformat}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@qpid.apache.org
For additional commands, e-mail: dev-help@qpid.apache.org