You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zy-kkk (via GitHub)" <gi...@apache.org> on 2025/11/10 09:30:48 UTC

[PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

zy-kkk opened a new pull request, #57856:
URL: https://github.com/apache/doris/pull/57856

    **Symptom:** External table queries hang indefinitely, FE process frozen.
   
   **User-facing impact:** Query threads blocked waiting for schema cache:
   
     ```
     "mysql-nio-pool-14981" TIMED_WAITING
        at LinkedBlockingQueue.offer(LinkedBlockingQueue.java:385)
        at ThreadPoolManager$BlockedPolicy.rejectedExecution(ThreadPoolManager.java:347)
        at ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379)
        at CompletableFuture.asyncSupplyStage(CompletableFuture.java:1618)
        at CacheLoader.asyncReload(CacheLoader.java:188)
        at BoundedLocalCache.refreshIfNeeded(BoundedLocalCache.java:1214)
        at LocalLoadingCache.get(LocalLoadingCache.java:56)
        at ExternalSchemaCache.getSchemaValue(ExternalSchemaCache.java:86)
        at ExternalTable.getSchemaCacheValue(ExternalTable.java:371)
        at HMSExternalTable.getPartitionColumns(HMSExternalTable.java:288)
        at PruneFileScanPartition.pruneHivePartitions(PruneFileScanPartition.java:84)
   
     "CommonRefreshExecutor-63" TIMED_WAITING
        at LinkedBlockingQueue.offer(LinkedBlockingQueue.java:385)
        at ThreadPoolManager$BlockedPolicy.rejectedExecution(ThreadPoolManager.java:347)
        at ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379)
        at CompletableFuture.asyncSupplyStage(CompletableFuture.java:1618)
        at CacheLoader.asyncReload(CacheLoader.java:188)
        at BoundedLocalCache.refreshIfNeeded(BoundedLocalCache.java:1214)
   
     "CommonRefreshExecutor-62" TIMED_WAITING
        at LinkedBlockingQueue.offer(LinkedBlockingQueue.java:385)
        at ThreadPoolManager$BlockedPolicy.rejectedExecution(ThreadPoolManager.java:347)
        at ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379)
        at BoundedLocalCache.notifyRemoval(BoundedLocalCache.java:333)
        at BoundedLocalCache.removeNode(BoundedLocalCache.java:1882)
        at LocalManualCache.invalidateAll(LocalManualCache.java:150)
        at MetaCache.invalidateAll(MetaCache.java:121)
        at ExternalDatabase.setUnInitialized(ExternalDatabase.java:123)
   ```
   
    **Root cause**: Caffeine cache deadlock when:
     1. MetaCache uses bounded executor (CommonRefreshExecutor: 64 threads + 640K queue) for both async operations and removal listeners
     2. Database cache removal listener calls tableCache.invalidateAll()
     3. Executor is full (all threads busy + queue full)
     4. Both async reload and removal listener try to submit tasks to full executor
     5. Deadlock: executor threads wait for tasks, tasks wait for executor slots
   
     Jstack evidence: 82 CommonRefreshExecutor threads blocked on LinkedBlockingQueue.offer():
   
   **Solution**
   
     - Add CacheFactory.buildCacheWithSyncRemovalListener() using Runnable::run executor
     - MetaCache.metaObjCache uses sync removal listener to avoid executor contention
     - Removal listener runs inline on calling thread instead of submitting to executor
   
   **Changes**
   
     - CacheFactory: Add buildCacheWithSyncRemovalListener() and buildCacheWithAsyncRemovalListener()
     - MetaCache: Use buildCacheWithSyncRemovalListener() for metaObjCache
     - Add MetaCacheDeadlockTest to verify fix
   
   **Test**
   
     Unit test reproduces deadlock with async removal listener and verifies fix with sync removal listener.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3510483594

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3530674967

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 27.44 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 9c53e44b0503720fe6af275a4cb750559a49bcc1, data reload: false
   
   query1	0.06	0.04	0.05
   query2	0.09	0.05	0.04
   query3	0.26	0.08	0.08
   query4	1.61	0.12	0.11
   query5	0.27	0.25	0.24
   query6	1.19	0.65	0.63
   query7	0.03	0.03	0.02
   query8	0.05	0.04	0.04
   query9	0.58	0.52	0.54
   query10	0.57	0.57	0.57
   query11	0.16	0.11	0.11
   query12	0.15	0.12	0.12
   query13	0.62	0.60	0.60
   query14	1.01	0.99	1.00
   query15	0.85	0.83	0.86
   query16	0.39	0.40	0.39
   query17	1.07	1.05	1.03
   query18	0.22	0.20	0.20
   query19	1.92	1.77	1.78
   query20	0.02	0.01	0.01
   query21	15.43	0.20	0.13
   query22	5.02	0.06	0.05
   query23	15.67	0.27	0.11
   query24	3.02	0.58	0.45
   query25	0.07	0.07	0.06
   query26	0.15	0.13	0.13
   query27	0.06	0.06	0.05
   query28	3.69	1.14	0.95
   query29	12.55	3.91	3.21
   query30	0.29	0.13	0.12
   query31	2.83	0.59	0.37
   query32	3.22	0.55	0.46
   query33	3.10	3.09	3.08
   query34	15.71	5.19	4.55
   query35	4.52	4.54	4.59
   query36	0.68	0.50	0.50
   query37	0.10	0.06	0.07
   query38	0.07	0.04	0.04
   query39	0.04	0.03	0.03
   query40	0.18	0.14	0.13
   query41	0.09	0.03	0.04
   query42	0.03	0.03	0.02
   query43	0.05	0.03	0.04
   Total cold run time: 97.69 s
   Total hot run time: 27.44 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "morningman (via GitHub)" <gi...@apache.org>.
morningman merged PR #57856:
URL: https://github.com/apache/doris/pull/57856


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3530939633

   # FE Regression Coverage Report
   Increment line coverage `  85.00% (17/20)` :tada:
   [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57856_9c53e44b0503720fe6af275a4cb750559a49bcc1_merge_fe/increment_report/index.html)
   [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57856_9c53e44b0503720fe6af275a4cb750559a49bcc1_merge_fe/report/index.html)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3530664121

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 187541 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 9c53e44b0503720fe6af275a4cb750559a49bcc1, data reload: false
   
   query1	1031	399	395	395
   query2	6569	1675	1708	1675
   query3	6761	235	223	223
   query4	26474	23366	23325	23325
   query5	4432	626	496	496
   query6	350	249	226	226
   query7	4655	498	304	304
   query8	310	267	263	263
   query9	8747	2620	2620	2620
   query10	513	352	289	289
   query11	15950	15144	14982	14982
   query12	182	118	113	113
   query13	1685	575	444	444
   query14	11048	9180	9189	9180
   query15	220	194	180	180
   query16	7480	678	545	545
   query17	1218	755	612	612
   query18	2012	414	318	318
   query19	205	193	177	177
   query20	136	126	125	125
   query21	217	130	110	110
   query22	4042	4044	3957	3957
   query23	34130	32791	32860	32791
   query24	8431	2400	2369	2369
   query25	597	501	455	455
   query26	1248	278	157	157
   query27	2765	501	348	348
   query28	4313	2212	2200	2200
   query29	803	604	469	469
   query30	299	225	195	195
   query31	918	814	712	712
   query32	85	75	72	72
   query33	587	397	324	324
   query34	797	831	521	521
   query35	805	839	734	734
   query36	961	987	905	905
   query37	115	113	86	86
   query38	3513	3489	3481	3481
   query39	1478	1423	1423	1423
   query40	229	132	117	117
   query41	62	59	65	59
   query42	126	110	115	110
   query43	497	491	470	470
   query44	1209	736	734	734
   query45	188	173	170	170
   query46	891	980	626	626
   query47	1783	1800	1747	1747
   query48	385	424	311	311
   query49	786	507	408	408
   query50	637	674	393	393
   query51	3889	3999	3887	3887
   query52	114	108	98	98
   query53	239	263	186	186
   query54	300	296	269	269
   query55	88	85	83	83
   query56	309	311	317	311
   query57	1197	1235	1122	1122
   query58	285	280	271	271
   query59	2523	2696	2560	2560
   query60	340	347	325	325
   query61	161	156	155	155
   query62	809	707	658	658
   query63	225	190	195	190
   query64	4422	1140	872	872
   query65	4027	3925	3928	3925
   query66	1143	439	337	337
   query67	15235	14980	14978	14978
   query68	5608	945	602	602
   query69	487	319	292	292
   query70	1351	1319	1286	1286
   query71	434	336	310	310
   query72	6003	5052	5053	5052
   query73	629	563	362	362
   query74	8991	9057	8744	8744
   query75	3315	3330	2855	2855
   query76	3372	1139	742	742
   query77	513	408	326	326
   query78	9502	9693	8813	8813
   query79	2456	827	591	591
   query80	712	566	503	503
   query81	504	263	234	234
   query82	453	157	129	129
   query83	277	260	246	246
   query84	261	109	96	96
   query85	950	477	435	435
   query86	381	310	295	295
   query87	3728	3639	3632	3632
   query88	3808	2239	2185	2185
   query89	393	332	290	290
   query90	1971	220	213	213
   query91	185	165	135	135
   query92	80	67	65	65
   query93	2156	976	644	644
   query94	758	420	338	338
   query95	402	305	304	304
   query96	492	571	284	284
   query97	2911	2967	2875	2875
   query98	247	221	213	213
   query99	1338	1409	1277	1277
   Total cold run time: 272849 ms
   Total hot run time: 187541 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "zy-kkk (via GitHub)" <gi...@apache.org>.
zy-kkk commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3530601616

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3510791975

   
   <details>
   <summary>TPC-DS: <b>Total hot run time: 186030 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
   TPC-DS sf100 test result on commit 4c9920b949381d14e6da0c2495559c16a8411248, data reload: false
   
   query1	1049	404	403	403
   query2	6603	1703	1702	1702
   query3	6770	226	218	218
   query4	26345	23412	23037	23037
   query5	4382	627	487	487
   query6	325	244	226	226
   query7	4656	500	301	301
   query8	312	260	263	260
   query9	8699	2590	2601	2590
   query10	495	330	298	298
   query11	15242	15060	14869	14869
   query12	174	120	116	116
   query13	1674	577	428	428
   query14	10976	9334	9384	9334
   query15	202	193	174	174
   query16	7653	686	497	497
   query17	1240	736	604	604
   query18	2026	451	316	316
   query19	212	203	178	178
   query20	126	124	122	122
   query21	214	130	116	116
   query22	4022	4073	3913	3913
   query23	34084	33204	32819	32819
   query24	8410	2493	2464	2464
   query25	602	526	453	453
   query26	1227	266	159	159
   query27	2774	502	365	365
   query28	4348	2205	2180	2180
   query29	830	623	494	494
   query30	303	232	196	196
   query31	912	812	747	747
   query32	83	82	84	82
   query33	634	373	348	348
   query34	791	850	537	537
   query35	853	844	750	750
   query36	952	984	926	926
   query37	125	113	89	89
   query38	3551	3593	3503	3503
   query39	1480	1408	1418	1408
   query40	223	136	123	123
   query41	66	62	63	62
   query42	127	116	114	114
   query43	511	498	477	477
   query44	1250	762	742	742
   query45	189	186	174	174
   query46	895	988	665	665
   query47	1748	1754	1726	1726
   query48	419	432	327	327
   query49	793	536	442	442
   query50	650	692	420	420
   query51	3867	3947	3986	3947
   query52	118	113	104	104
   query53	245	275	208	208
   query54	329	326	309	309
   query55	97	90	86	86
   query56	352	346	344	344
   query57	1172	1187	1117	1117
   query58	306	296	295	295
   query59	2500	2671	2496	2496
   query60	363	347	357	347
   query61	201	189	193	189
   query62	815	749	679	679
   query63	237	204	217	204
   query64	4638	1309	990	990
   query65	4023	4050	3956	3956
   query66	1168	462	360	360
   query67	15631	15348	15008	15008
   query68	7720	914	609	609
   query69	509	339	314	314
   query70	1246	1303	1269	1269
   query71	456	349	328	328
   query72	6319	4864	2689	2689
   query73	647	572	363	363
   query74	9137	8783	8732	8732
   query75	3335	3326	2806	2806
   query76	3345	1146	763	763
   query77	530	414	322	322
   query78	9686	9722	8897	8897
   query79	2454	848	612	612
   query80	739	603	519	519
   query81	514	266	236	236
   query82	469	164	139	139
   query83	271	267	249	249
   query84	260	113	102	102
   query85	944	497	456	456
   query86	382	322	299	299
   query87	3725	3701	3643	3643
   query88	3764	2291	2296	2291
   query89	386	349	290	290
   query90	1944	234	231	231
   query91	174	172	132	132
   query92	80	72	62	62
   query93	2101	1024	664	664
   query94	771	463	359	359
   query95	418	330	313	313
   query96	488	589	292	292
   query97	2928	2948	2878	2878
   query98	253	220	210	210
   query99	1372	1450	1341	1341
   Total cold run time: 275656 ms
   Total hot run time: 186030 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3510742756

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 34314 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 4c9920b949381d14e6da0c2495559c16a8411248, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17611	5162	5039	5039
   q2	2023	325	212	212
   q3	10272	1323	727	727
   q4	10237	960	389	389
   q5	7494	2476	2343	2343
   q6	183	170	137	137
   q7	956	774	666	666
   q8	9384	1321	1103	1103
   q9	6975	5122	5190	5122
   q10	6822	2233	1830	1830
   q11	510	307	293	293
   q12	343	371	232	232
   q13	17763	3704	3080	3080
   q14	235	250	212	212
   q15	571	512	532	512
   q16	1008	1007	957	957
   q17	581	923	379	379
   q18	7375	7177	6983	6983
   q19	1238	950	569	569
   q20	358	346	230	230
   q21	3742	3176	2329	2329
   q22	1068	1027	970	970
   Total cold run time: 106749 ms
   Total hot run time: 34314 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5122	5115	5089	5089
   q2	246	328	234	234
   q3	2169	2707	2307	2307
   q4	1341	1772	1332	1332
   q5	4261	4469	4614	4469
   q6	222	185	148	148
   q7	2074	1987	1869	1869
   q8	2648	2677	2575	2575
   q9	7307	7434	7246	7246
   q10	3025	3343	2815	2815
   q11	598	523	512	512
   q12	678	775	613	613
   q13	3862	3884	3374	3374
   q14	299	310	294	294
   q15	562	535	534	534
   q16	1086	1101	1096	1096
   q17	1231	1611	1400	1400
   q18	7942	7716	7504	7504
   q19	836	907	899	899
   q20	2070	2110	1950	1950
   q21	5095	4769	4352	4352
   q22	1097	1045	988	988
   Total cold run time: 53771 ms
   Total hot run time: 51600 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3530636901

   
   <details>
   <summary>TPC-H: <b>Total hot run time: 34184 ms</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
   Tpch sf100 test result on commit 9c53e44b0503720fe6af275a4cb750559a49bcc1, data reload: false
   
   ------ Round 1 ----------------------------------
   q1	17244	5177	4984	4984
   q2	2014	314	249	249
   q3	10156	1324	744	744
   q4	10228	961	392	392
   q5	7561	2317	2407	2317
   q6	180	166	135	135
   q7	912	836	629	629
   q8	9343	1393	1142	1142
   q9	7012	5074	5123	5074
   q10	6801	2224	1821	1821
   q11	521	302	281	281
   q12	332	361	231	231
   q13	17769	3665	3052	3052
   q14	230	235	219	219
   q15	560	515	503	503
   q16	1037	997	943	943
   q17	576	865	365	365
   q18	7944	7066	7141	7066
   q19	1079	956	559	559
   q20	340	336	234	234
   q21	3703	2543	2255	2255
   q22	1051	1034	989	989
   Total cold run time: 106593 ms
   Total hot run time: 34184 ms
   
   ----- Round 2, with runtime_filter_mode=off -----
   q1	5067	5062	5053	5053
   q2	251	325	234	234
   q3	2210	2706	2247	2247
   q4	1377	1755	1321	1321
   q5	4201	4376	4662	4376
   q6	216	169	131	131
   q7	2123	1960	1809	1809
   q8	2644	2685	2585	2585
   q9	7292	7480	7301	7301
   q10	3021	3225	2866	2866
   q11	585	541	502	502
   q12	667	751	685	685
   q13	3666	3946	3477	3477
   q14	302	314	280	280
   q15	529	488	551	488
   q16	1123	1140	1089	1089
   q17	1181	1497	1459	1459
   q18	7852	7704	7513	7513
   q19	809	821	803	803
   q20	2012	2102	1916	1916
   q21	5028	4349	4351	4349
   q22	1096	1051	978	978
   Total cold run time: 53252 ms
   Total hot run time: 51462 ms
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3510815860

   
   <details>
   <summary>ClickBench: <b>Total hot run time: 27.81 s</b></summary>
   
   ```
   machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
   ClickBench test result on commit 4c9920b949381d14e6da0c2495559c16a8411248, data reload: false
   
   query1	0.06	0.04	0.04
   query2	0.10	0.05	0.05
   query3	0.26	0.09	0.09
   query4	1.61	0.12	0.11
   query5	0.28	0.26	0.24
   query6	1.19	0.66	0.64
   query7	0.04	0.03	0.03
   query8	0.06	0.05	0.05
   query9	0.60	0.52	0.51
   query10	0.58	0.58	0.59
   query11	0.16	0.11	0.11
   query12	0.15	0.12	0.12
   query13	0.63	0.61	0.59
   query14	1.00	1.00	1.00
   query15	0.85	0.83	0.84
   query16	0.40	0.38	0.39
   query17	1.00	1.02	1.01
   query18	0.22	0.20	0.21
   query19	1.88	1.74	1.84
   query20	0.01	0.01	0.01
   query21	15.44	0.21	0.13
   query22	4.91	0.07	0.05
   query23	15.67	0.26	0.11
   query24	2.87	0.74	1.01
   query25	0.07	0.06	0.06
   query26	0.15	0.13	0.14
   query27	0.06	0.05	0.06
   query28	4.87	1.15	0.93
   query29	12.58	3.89	3.22
   query30	0.28	0.15	0.14
   query31	2.82	0.61	0.38
   query32	3.24	0.56	0.48
   query33	3.06	3.03	3.05
   query34	15.88	5.20	4.56
   query35	4.56	4.62	4.61
   query36	0.69	0.51	0.49
   query37	0.10	0.07	0.07
   query38	0.07	0.05	0.04
   query39	0.03	0.03	0.03
   query40	0.17	0.14	0.14
   query41	0.09	0.03	0.04
   query42	0.04	0.03	0.03
   query43	0.04	0.03	0.03
   Total cold run time: 98.77 s
   Total hot run time: 27.81 s
   ```
   </details>
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3536245539

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3510425858

   
   Thank you for your contribution to Apache Doris.
   Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
   
   Please clearly describe your PR:
   1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
   2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
   3. What features were added. Why was this function added?
   4. Which code was refactored and why was this part of the code refactored?
   5. Which functions were optimized and what is the difference before and after the optimization?
       


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3536245564

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3536267199

   # FE Regression Coverage Report
   Increment line coverage `  85.00% (17/20)` :tada:
   [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57856_9c53e44b0503720fe6af275a4cb750559a49bcc1_merge_fe/increment_report/index.html)
   [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57856_9c53e44b0503720fe6af275a4cb750559a49bcc1_merge_fe/report/index.html)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [fix](metacache) Fix query hang caused by Caffeine cache deadlock in external table queries [doris]

Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #57856:
URL: https://github.com/apache/doris/pull/57856#issuecomment-3512201224

   # FE Regression Coverage Report
   Increment line coverage `  50.00% (10/20)` :tada:
   [Increment coverage report](http://coverage.selectdb-in.cc/coverage/57856_4c9920b949381d14e6da0c2495559c16a8411248_merge_fe/increment_report/index.html)
   [Complete coverage report](http://coverage.selectdb-in.cc/coverage/57856_4c9920b949381d14e6da0c2495559c16a8411248_merge_fe/report/index.html)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org