You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@helix.apache.org by GitBox <gi...@apache.org> on 2020/08/11 03:01:55 UTC

[GitHub] [helix] kaisun2000 opened a new issue #1246: Fix TestZkCallbackHandlerLeak thread leakage around 400

kaisun2000 opened a new issue #1246:
URL: https://github.com/apache/helix/issues/1246


   Log:
   
   > TestZkCallbackHandlerLeak has active threads cnt:377
   zookeeper server threads has 4 thread
   Failure zkclient/zooKeeper session threads has 71 thread
   0 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12918_PARTICIPANT_10012-SendThread(localhost:2183)
   1 thread:ZkClient-AsyncCallback-Retry-23-localhost:2183
   2 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12920_PARTICIPANT_10014-SendThread(localhost:2183)
   3 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_localhost_12918_PARTICIPANT_10007-SendThread(localhost:2183)
   4 thread:main-EventThread
   5 thread:main-SendThread(localhost:2183)
   6 thread:ZkClient-EventThread-24-localhost:2183
   7 thread:ZkClient-AsyncCallback-Retry-484-localhost:2183
   8 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_localhost_12919_PARTICIPANT_10008-SendThread(localhost:2183)
   9 thread:ZkClient-EventThread-485-localhost:2183
   10 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_localhost_12918_PARTICIPANT_10007-EventThread
   11 thread:ZkClient-EventThread-436-localhost:2183
   12 thread:ZkClient-AsyncCallback-Retry-635-localhost:2183
   13 thread:main-SendThread(localhost:2183)
   14 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12919_PARTICIPANT_10013-SendThread(localhost:2183)
   15 thread:HelixController-pipeline-default-TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval-(7dc73d81_DEFAULT)-EventThread
   16 thread:ZkClient-EventThread-451-localhost:2183
   17 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_controller_0_CONTROLLER_10011-EventThread
   18 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12918_PARTICIPANT_10012-EventThread
   19 thread:ZkClient-EventThread-513-localhost:2183
   20 thread:main-EventThread
   21 thread:ZkClient-EventThread-742-localhost:2183
   22 thread:ZkClient-EventThread-440-localhost:2183
   23 thread:ZkClient-EventThread-640-localhost:2183
   24 thread:ZkClient-AsyncCallback-Retry-639-localhost:2183
   25 thread:ZkClient-AsyncCallback-Retry-435-localhost:2183
   26 thread:main-SendThread(localhost:2183)
   27 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testRemoveUserCbHandlerOnPathRemoval_localhost_12920_PARTICIPANT_10019-SendThread(localhost:2183)
   28 thread:ZkClient-EventThread-651-localhost:2183
   29 thread:ZkClient-EventThread-382-localhost:2183
   30 thread:ZkClient-AsyncCallback-Retry-19-localhost:2183
   31 thread:main-EventThread
   32 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_router_SPECTATOR_10015-SendThread(localhost:2183)
   33 thread:ZkClient-EventThread-472-localhost:2183
   34 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12919_PARTICIPANT_10013-EventThread
   35 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testRemoveUserCbHandlerOnPathRemoval_localhost_12919_PARTICIPANT_10018-SendThread(localhost:2183)
   36 thread:ZkClient-AsyncCallback-Retry-439-localhost:2183
   37 thread:ZkClient-AsyncCallback-Retry-686-localhost:2183
   38 thread:main-EventThread
   39 thread:ZkClient-AsyncCallback-Retry-450-localhost:2183
   40 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_router_SPECTATOR_10010-SendThread(localhost:2183)
   41 thread:ZkClient-AsyncCallback-Retry-671-localhost:2183
   42 thread:ZkClient-AsyncCallback-Retry-604-localhost:2183
   43 thread:main-SendThread(localhost:2183)
   44 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_router_SPECTATOR_10010-EventThread
   45 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testRemoveUserCbHandlerOnPathRemoval_localhost_12918_PARTICIPANT_10017-SendThread(localhost:2183)
   46 thread:ZkClient-EventThread-687-localhost:2183
   47 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_localhost_12919_PARTICIPANT_10008-EventThread
   48 thread:ZkClient-EventThread-20-localhost:2183
   49 thread:ZkClient-EventThread-605-localhost:2183
   50 thread:ZkClient-AsyncCallback-Retry-650-localhost:2183
   51 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testRemoveUserCbHandlerOnPathRemoval_controller_0_CONTROLLER_10016-SendThread(localhost:2183)
   52 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_localhost_12920_PARTICIPANT_10009-SendThread(localhost:2183)
   53 thread:ZkClient-AsyncCallback-Retry-381-localhost:2183
   54 thread:ZkClient-AsyncCallback-Retry-741-localhost:2183
   55 thread:HelixController-pipeline-task-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix-(681e09f1_TASK)-EventThread
   56 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12920_PARTICIPANT_10014-EventThread
   57 thread:ZkClient-AsyncCallback-Retry-471-localhost:2183
   58 thread:ZkClient-EventThread-672-localhost:2183
   59 thread:ZkClient-EventThread-808-localhost:2183
   60 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_router_SPECTATOR_10015-EventThread
   61 thread:ZkClient-AsyncCallback-Retry-512-localhost:2183
   62 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_controller_0_CONTROLLER_10006-EventThread
   63 thread:main-SendThread(localhost:2183)
   64 thread:ZkClient-AsyncCallback-Retry-807-localhost:2183
   65 thread:main-EventThread
   66 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_localhost_12920_PARTICIPANT_10009-EventThread
   67 thread:main-SendThread(localhost:2183)
   68 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_controller_0_CONTROLLER_10006-SendThread(localhost:2183)
   69 thread:ZkClient-EventThread-636-localhost:2183
   70 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_controller_0_CONTROLLER_10011-SendThread(localhost:2183)
   fork join pool threads has 2 thread
   Failure timer threads has 20 thread
   0 thread:HelixTaskExecutor_timer
   1 thread:HelixTaskExecutor_timer
   2 thread:StatusDumpTimerTask
   3 thread:HelixTaskExecutor_timer
   4 thread:HelixTaskExecutor_timer
   5 thread:ParticipantHealthReportTimerTask
   6 thread:GenericHelixController_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_onDemand_Timer
   7 thread:ParticipantHealthReportTimerTask
   8 thread:HelixTaskExecutor_timer
   9 thread:HelixTaskExecutor_timer
   10 thread:HelixTaskExecutor_timer
   11 thread:ParticipantHealthReportTimerTask
   12 thread:HelixTaskExecutor_timer
   13 thread:ParticipantHealthReportTimerTask
   14 thread:GenericHelixController_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_onDemand_Timer
   15 thread:HelixTaskExecutor_timer
   16 thread:HelixTaskExecutor_timer
   17 thread:ParticipantHealthReportTimerTask
   18 thread:StatusDumpTimerTask
   19 thread:ParticipantHealthReportTimerTask
   Failure Other threads has 277 thread
   0 thread:HelixTaskExecutor-message_handle_thread_311
   1 thread:HelixTaskExecutor-message_handle_thread_234
   2 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   3 thread:CustomizedStateViewComputeWorker-TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval
   4 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   5 thread:HelixTaskExecutor-message_handle_thread_213
   6 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   7 thread:HelixTaskExecutor-message_handle_thread_179
   8 thread:HelixTaskExecutor-message_handle_thread_349
   9 thread:HelixTaskExecutor-message_handle_thread_360
   10 thread:HelixTaskExecutor-message_handle_thread_163
   11 thread:HelixTaskExecutor-message_handle_thread_229
   12 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   13 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   14 thread:HelixTaskExecutor-message_handle_thread_263
   15 thread:HelixTaskExecutor-message_handle_thread_332
   16 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_controller_0_CONTROLLER_10011
   17 thread:HelixTaskExecutor-message_handle_thread_222
   18 thread:HelixTaskExecutor-message_handle_thread_211
   19 thread:HelixController-async_tasks-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix
   20 thread:HelixTaskExecutor-message_handle_thread_224
   21 thread:HelixController-pipeline-default-TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval-(localhost:2183)
   22 thread:HelixTaskExecutor-message_handle_thread_216
   23 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval_router_SPECTATOR_10010
   24 thread:HelixTaskExecutor-message_handle_thread_356
   25 thread:HelixTaskExecutor-message_handle_thread_352
   26 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12919_PARTICIPANT_10013
   27 thread:MaintenanceRecoveryWorker-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix
   28 thread:HelixTaskExecutor-message_handle_thread_345
   29 thread:HelixController-async_tasks-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix
   30 thread:HelixTaskExecutor-message_handle_thread_248
   31 thread:HelixTaskExecutor-message_handle_thread_185
   32 thread:HelixTaskExecutor-message_handle_thread_310
   33 thread:HelixTaskExecutor-message_handle_thread_238
   34 thread:HelixTaskExecutor-message_handle_thread_383
   35 thread:HelixTaskExecutor-message_handle_thread_368
   36 thread:HelixTaskExecutor-message_handle_thread_361
   37 thread:PersistAssignmentWorker-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix
   38 thread:pool-35-thread-1
   39 thread:HelixController-async_tasks-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix
   40 thread:HelixTaskExecutor-message_handle_thread_249
   41 thread:CustomizedStateViewComputeWorker-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix
   42 thread:HelixTaskExecutor-message_handle_thread_342
   43 thread:HelixTaskExecutor-message_handle_thread_220
   44 thread:HelixController-async_tasks-TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix
   45 thread:HelixTaskExecutor-message_handle_thread_207
   46 thread:HelixTaskExecutor-message_handle_thread_245
   47 thread:HelixTaskExecutor-message_handle_thread_324
   48 thread:HelixTaskExecutor-message_handle_thread_314
   49 thread:HelixTaskExecutor-message_handle_thread_193
   50 thread:HelixTaskExecutor-message_handle_thread_366
   51 thread:ClusterManager_Watcher_TestZkCallbackHandlerLeak_testDanglingCallbackHanlderFix_localhost_12918_PARTICIPANT_10012
   52 thread:HelixTaskExecutor-message_handle_thread_355
   53 thread:HelixTaskExecutor-message_handle_thread_208
   54 thread:HelixTaskExecutor-message_handle_thread_165
   55 thread:HelixTaskExecutor-message_handle_thread_255
   56 thread:HelixTaskExecutor-message_handle_thread_348
   57 thread:HelixTaskExecutor-message_handle_thread_339
   58 thread:HelixTaskExecutor-message_handle_thread_306
   59 thread:HelixTaskExecutor-message_handle_thread_169
   60 thread:HelixTaskExecutor-message_handle_thread_335
   61 thread:HelixTaskExecutor-message_handle_thread_215
   62 thread:HelixTaskExecutor-message_handle_thread_226
   63 thread:HelixTaskExecutor-message_handle_thread_198
   64 thread:HelixTaskExecutor-message_handle_thread_256
   65 thread:HelixTaskExecutor-message_handle_thread_200
   66 thread:HelixTaskExecutor-message_handle_thread_218
   67 thread:HelixTaskExecutor-message_handle_thread_375
   68 thread:HelixTaskExecutor-message_handle_thread_254
   69 thread:HelixTaskExecutor-message_handle_thread_262
   70 thread:HelixTaskExecutor-message_handle_thread_385
   71 thread:HelixTaskExecutor-message_handle_thread_382
   72 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   73 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   74 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   75 thread:HelixTaskExecutor-message_handle_thread_303
   76 thread:HelixTaskExecutor-message_handle_STATE_TRANSITION
   77 thread:HelixTaskExecutor-message_handle_thread_362
   78 thread:HelixTaskExecutor-message_handle_thread_359
   79 thread:HelixTaskExecutor-message_handle_thread_203
   80 thread:pool-36-thread-1
   81 thread:HelixTaskExecutor-message_handle_thread_322
   82 thread:HelixTaskExecutor-message_handle_thread_300
   83 thread:HelixTaskExecutor-message_handle_thread_347
   84 thread:HelixTaskExecutor-message_handle_thread_374
   85 thread:HelixTaskExecutor-message_handle_thread_210
   86 thread:HelixController-async_tasks-TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval
   87 thread:HelixController-async_tasks-TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval
   88 thread:HelixTaskExecutor-message_handle_thread_369
   89 thread:HelixTaskExecutor-message_handle_thread_334
   90 thread:HelixTaskExecutor-message_handle_thread_252
   91 thread:HelixTaskExecutor-message_handle_thread_217
   92 thread:HelixTaskExecutor-message_handle_thread_377
   93 thread:HelixTaskExecutor-message_handle_thread_257
   94 thread:HelixTaskExecutor-message_handle_thread_376
   95 thread:HelixTaskExecutor-message_handle_thread_379
   96 thread:HelixTaskExecutor-message_handle_thread_237
   97 thread:HelixController-async_tasks-TestZkCallbackHandlerLeak_testCurrentStatePathLeakingByAsycRemoval
   98 thread:HelixTaskExecutor-message_handle_thread_305
   99 thread:HelixTaskExecutor-message_handle_thread_247
    skipping the rest
   ---------- Test Class TestZkCallbackHandlerLeak thread leakage detected! ---------------
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@helix.apache.org
For additional commands, e-mail: reviews-help@helix.apache.org


[GitHub] [helix] kaisun2000 commented on issue #1246: Fix TestZkCallbackHandlerLeak thread leakage around 400

Posted by GitBox <gi...@apache.org>.
kaisun2000 commented on issue #1246:
URL: https://github.com/apache/helix/issues/1246#issuecomment-671696551


   This is huge one. Now we have around 1200 leaking threads. This one takes around 1/3


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@helix.apache.org
For additional commands, e-mail: reviews-help@helix.apache.org


[GitHub] [helix] kaisun2000 commented on issue #1246: Fix TestZkCallbackHandlerLeak thread leakage around 400

Posted by GitBox <gi...@apache.org>.
kaisun2000 commented on issue #1246:
URL: https://github.com/apache/helix/issues/1246#issuecomment-671787750


   https://github.com/apache/helix/pull/1227 addressed this one.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@helix.apache.org
For additional commands, e-mail: reviews-help@helix.apache.org