You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "luwei16 (via GitHub)" <gi...@apache.org> on 2024/03/13 08:27:47 UTC
[PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
luwei16 opened a new pull request, #32181:
URL: https://github.com/apache/doris/pull/32181
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "luwei16 (via GitHub)" <gi...@apache.org>.
luwei16 commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993988647
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993867937
<details>
<summary>ClickBench: <b>Total hot run time: 29.97 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0a801b11390ef0d2230acd711ec5716dd2d415a9, data reload: false
query1 0.04 0.04 0.03
query2 0.07 0.02 0.03
query3 0.23 0.06 0.06
query4 1.64 0.10 0.10
query5 0.49 0.49 0.52
query6 1.25 0.62 0.62
query7 0.02 0.02 0.02
query8 0.04 0.03 0.03
query9 0.55 0.49 0.50
query10 0.54 0.54 0.54
query11 0.12 0.08 0.08
query12 0.12 0.09 0.09
query13 0.56 0.57 0.56
query14 0.72 0.76 0.72
query15 0.80 0.77 0.78
query16 0.39 0.41 0.39
query17 1.02 1.03 0.96
query18 0.18 0.26 0.22
query19 1.83 1.65 1.69
query20 0.02 0.01 0.01
query21 15.79 0.56 0.56
query22 2.31 2.70 1.82
query23 17.27 0.71 0.75
query24 4.70 1.00 1.47
query25 0.16 0.15 0.05
query26 0.75 0.12 0.12
query27 0.05 0.03 0.03
query28 9.94 0.88 0.84
query29 12.51 3.13 3.08
query30 0.68 0.55 0.60
query31 2.80 0.33 0.32
query32 3.38 0.44 0.44
query33 2.81 2.77 2.87
query34 16.14 4.32 4.26
query35 4.31 4.29 4.35
query36 1.07 1.01 1.01
query37 0.08 0.06 0.05
query38 0.04 0.03 0.03
query39 0.03 0.01 0.02
query40 0.16 0.13 0.13
query41 0.08 0.02 0.02
query42 0.03 0.02 0.01
query43 0.03 0.03 0.02
Total cold run time: 105.75 s
Total hot run time: 29.97 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993838373
<details>
<summary>TPC-H: <b>Total hot run time: 36970 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0a801b11390ef0d2230acd711ec5716dd2d415a9, data reload: false
------ Round 1 ----------------------------------
q1 5439 4252 4172 4172
q2 525 159 152 152
q3 1337 914 904 904
q4 1038 714 712 712
q5 2631 2886 2857 2857
q6 187 126 123 123
q7 1219 816 805 805
q8 1952 2105 2188 2105
q9 6511 6466 6493 6466
q10 8233 2542 2510 2510
q11 423 216 215 215
q12 837 302 301 301
q13 17959 2992 2999 2992
q14 276 254 247 247
q15 494 442 447 442
q16 478 389 392 389
q17 949 645 579 579
q18 6548 6021 5844 5844
q19 1573 1484 1382 1382
q20 544 273 269 269
q21 6845 3277 3199 3199
q22 803 305 316 305
Total cold run time: 66801 ms
Total hot run time: 36970 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4099 4089 4080 4080
q2 314 233 228 228
q3 2968 2852 2846 2846
q4 1889 1555 1542 1542
q5 5222 5212 5268 5212
q6 197 116 113 113
q7 2208 1877 1863 1863
q8 3127 3272 3251 3251
q9 8534 8512 8572 8512
q10 6108 3705 3691 3691
q11 534 447 429 429
q12 738 520 551 520
q13 6899 2886 2856 2856
q14 272 241 249 241
q15 491 445 447 445
q16 463 397 414 397
q17 1728 1492 1472 1472
q18 7704 7321 7011 7011
q19 1605 1527 1466 1466
q20 1894 1701 1723 1701
q21 4937 4785 4679 4679
q22 528 456 459 456
Total cold run time: 62459 ms
Total hot run time: 53011 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993857901
TeamCity be ut coverage result:
Function Coverage: 35.01% (8576/24498)
Line Coverage: 26.77% (69478/259580)
Region Coverage: 26.03% (36080/138588)
Branch Coverage: 22.99% (18423/80140)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0a801b11390ef0d2230acd711ec5716dd2d415a9_0a801b11390ef0d2230acd711ec5716dd2d415a9/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993873389
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 0a801b11390ef0d2230acd711ec5716dd2d415a9 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.8 seconds inserted 10000000 Rows, about 724K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993864442
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993808903
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #32181:
URL: https://github.com/apache/doris/pull/32181
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993858677
<details>
<summary>TPC-DS: <b>Total hot run time: 187621 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0a801b11390ef0d2230acd711ec5716dd2d415a9, data reload: false
query1 910 363 344 344
query2 7504 2087 2077 2077
query3 6700 216 218 216
query4 31196 20717 20826 20717
query5 4454 406 485 406
query6 266 173 172 172
query7 4624 296 294 294
query8 221 162 175 162
query9 9900 2272 2247 2247
query10 457 235 262 235
query11 17134 14097 14167 14097
query12 146 89 88 88
query13 1640 428 428 428
query14 12178 10865 10553 10553
query15 264 219 195 195
query16 8017 255 242 242
query17 1972 552 524 524
query18 2021 273 271 271
query19 215 151 150 150
query20 85 87 82 82
query21 193 126 122 122
query22 4637 4504 4456 4456
query23 31799 31168 31158 31158
query24 10811 2780 2824 2780
query25 581 349 390 349
query26 890 168 155 155
query27 2396 352 349 349
query28 7218 1870 1852 1852
query29 905 643 611 611
query30 308 147 147 147
query31 971 734 733 733
query32 92 55 54 54
query33 767 245 240 240
query34 1118 470 482 470
query35 827 610 591 591
query36 985 895 870 870
query37 116 74 75 74
query38 3300 3140 3163 3140
query39 1397 1372 1423 1372
query40 208 112 105 105
query41 46 44 45 44
query42 104 97 98 97
query43 494 463 433 433
query44 1140 720 702 702
query45 265 249 256 249
query46 1084 702 682 682
query47 1699 1628 1586 1586
query48 457 354 376 354
query49 1103 336 336 336
query50 765 373 373 373
query51 6817 6731 6733 6731
query52 100 91 90 90
query53 337 283 274 274
query54 297 237 231 231
query55 87 81 79 79
query56 232 217 217 217
query57 1087 988 1005 988
query58 231 205 202 202
query59 2868 2625 2575 2575
query60 268 246 238 238
query61 113 113 126 113
query62 601 409 413 409
query63 298 274 276 274
query64 5448 3892 3942 3892
query65 3075 2994 2985 2985
query66 842 337 343 337
query67 14835 14358 14689 14358
query68 5720 534 548 534
query69 593 380 381 380
query70 1270 1203 1208 1203
query71 472 279 279 279
query72 6986 2794 2645 2645
query73 714 330 322 322
query74 7489 6628 6676 6628
query75 9127 8102 8097 8097
query76 4317 957 958 957
query77 665 294 266 266
query78 10478 9667 9535 9535
query79 8359 546 520 520
query80 1871 406 391 391
query81 540 210 221 210
query82 1636 201 206 201
query83 296 147 148 147
query84 283 76 79 76
query85 1478 312 304 304
query86 488 292 296 292
query87 3396 3195 3251 3195
query88 5089 2293 2286 2286
query89 520 374 364 364
query90 1942 182 174 174
query91 159 125 128 125
query92 61 45 47 45
query93 6858 510 490 490
query94 1218 177 178 177
query95 439 327 333 327
query96 596 270 276 270
query97 4371 4240 4289 4240
query98 231 220 224 220
query99 1089 744 744 744
Total cold run time: 312867 ms
Total hot run time: 187621 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993814123
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](merge-cloud) fix cloud cumu compaction thread not initializing thread local context [doris]
Posted by "luwei16 (via GitHub)" <gi...@apache.org>.
luwei16 commented on PR #32181:
URL: https://github.com/apache/doris/pull/32181#issuecomment-1993809109
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org