You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hust-hhb (via GitHub)" <gi...@apache.org> on 2024/06/04 10:25:17 UTC
[PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
hust-hhb opened a new pull request, #35869:
URL: https://github.com/apache/doris/pull/35869
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
Add profile for sync_rowsets while quering.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "hust-hhb (via GitHub)" <gi...@apache.org>.
hust-hhb commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147175419
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147238225
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #35869:
URL: https://github.com/apache/doris/pull/35869
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147265146
<details>
<summary>TPC-DS: <b>Total hot run time: 173363 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 76d46cc73f27e7932b9d84f2336c7a92697c618f, data reload: false
query1 922 379 375 375
query2 6455 2351 2469 2351
query3 6648 212 213 212
query4 19583 17341 17376 17341
query5 4127 452 457 452
query6 251 162 155 155
query7 4586 303 301 301
query8 313 281 292 281
query9 8525 2487 2463 2463
query10 457 296 308 296
query11 10595 10226 10131 10131
query12 141 90 88 88
query13 1642 361 354 354
query14 9395 6936 7544 6936
query15 224 187 181 181
query16 7830 277 282 277
query17 1270 516 523 516
query18 1962 270 269 269
query19 194 153 160 153
query20 96 84 85 84
query21 203 131 129 129
query22 4458 4313 3954 3954
query23 33783 32975 33088 32975
query24 11161 2919 2770 2770
query25 616 350 364 350
query26 1214 162 168 162
query27 3009 342 327 327
query28 7422 2093 2087 2087
query29 887 625 605 605
query30 306 149 152 149
query31 934 726 714 714
query32 86 50 52 50
query33 748 296 293 293
query34 928 502 487 487
query35 754 613 610 610
query36 1090 965 946 946
query37 154 75 101 75
query38 2857 2723 2726 2723
query39 875 784 789 784
query40 201 127 120 120
query41 55 52 50 50
query42 122 98 99 98
query43 578 563 555 555
query44 1250 726 747 726
query45 194 169 177 169
query46 1074 773 755 755
query47 1861 1773 1776 1773
query48 372 299 295 295
query49 978 396 399 396
query50 787 401 402 401
query51 6830 6731 6801 6731
query52 113 92 95 92
query53 351 296 289 289
query54 860 474 436 436
query55 75 75 72 72
query56 308 247 262 247
query57 1131 1027 1067 1027
query58 241 252 255 252
query59 3543 3150 3207 3150
query60 285 274 274 274
query61 103 89 91 89
query62 658 447 440 440
query63 319 286 288 286
query64 8856 2204 1713 1713
query65 3182 3100 3120 3100
query66 922 320 330 320
query67 15301 14872 14786 14786
query68 4463 548 560 548
query69 458 327 314 314
query70 1153 1131 1152 1131
query71 387 283 280 280
query72 7159 5731 6123 5731
query73 745 336 332 332
query74 5952 5510 5504 5504
query75 3387 2673 2683 2673
query76 2318 886 869 869
query77 455 294 306 294
query78 10225 9831 9773 9773
query79 1266 508 511 508
query80 2012 465 457 457
query81 584 218 222 218
query82 1271 103 101 101
query83 291 170 167 167
query84 272 87 83 83
query85 884 267 273 267
query86 341 318 335 318
query87 3238 3109 3093 3093
query88 3727 2483 2473 2473
query89 490 410 394 394
query90 1908 192 193 192
query91 137 112 109 109
query92 65 52 51 51
query93 1072 513 509 509
query94 1189 203 201 201
query95 416 326 329 326
query96 593 273 276 273
query97 3202 3079 3093 3079
query98 245 222 216 216
query99 1293 868 831 831
Total cold run time: 268449 ms
Total hot run time: 173363 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147225149
TeamCity be ut coverage result:
Function Coverage: 37.38% (9280/24823)
Line Coverage: 28.72% (75987/264602)
Region Coverage: 28.10% (39368/140089)
Branch Coverage: 24.51% (19909/81224)
Coverage Report: http://coverage.selectdb-in.cc/coverage/76d46cc73f27e7932b9d84f2336c7a92697c618f_76d46cc73f27e7932b9d84f2336c7a92697c618f/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147206193
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147276877
<details>
<summary>ClickBench: <b>Total hot run time: 30.45 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 76d46cc73f27e7932b9d84f2336c7a92697c618f, data reload: false
query1 0.04 0.03 0.03
query2 0.09 0.05 0.04
query3 0.23 0.05 0.05
query4 1.68 0.06 0.07
query5 0.51 0.50 0.50
query6 1.13 0.73 0.73
query7 0.02 0.02 0.01
query8 0.05 0.04 0.04
query9 0.53 0.50 0.50
query10 0.54 0.55 0.53
query11 0.15 0.11 0.11
query12 0.14 0.12 0.12
query13 0.59 0.60 0.60
query14 0.77 0.76 0.79
query15 0.83 0.80 0.80
query16 0.37 0.36 0.36
query17 0.98 0.99 1.02
query18 0.20 0.23 0.23
query19 1.78 1.68 1.67
query20 0.02 0.01 0.01
query21 15.80 0.66 0.66
query22 5.15 7.00 1.72
query23 18.27 1.40 1.34
query24 1.74 0.22 0.25
query25 0.14 0.08 0.07
query26 0.26 0.18 0.18
query27 0.08 0.08 0.08
query28 13.40 1.01 1.00
query29 13.35 3.35 3.32
query30 0.24 0.05 0.05
query31 2.88 0.40 0.38
query32 3.30 0.47 0.47
query33 2.86 2.90 2.90
query34 17.16 4.42 4.44
query35 4.46 4.47 4.57
query36 0.70 0.46 0.47
query37 0.18 0.16 0.15
query38 0.16 0.15 0.14
query39 0.05 0.03 0.04
query40 0.16 0.14 0.15
query41 0.09 0.04 0.05
query42 0.06 0.04 0.04
query43 0.03 0.03 0.04
Total cold run time: 111.17 s
Total hot run time: 30.45 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147186656
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147246109
<details>
<summary>TPC-H: <b>Total hot run time: 41134 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 76d46cc73f27e7932b9d84f2336c7a92697c618f, data reload: false
------ Round 1 ----------------------------------
q1 17618 4274 4295 4274
q2 2023 195 200 195
q3 10448 1165 1185 1165
q4 10191 853 893 853
q5 7504 2694 2737 2694
q6 232 138 137 137
q7 966 615 625 615
q8 9216 2138 2111 2111
q9 9321 6694 6727 6694
q10 9717 3909 3866 3866
q11 429 241 247 241
q12 466 249 234 234
q13 17458 3247 3208 3208
q14 269 225 231 225
q15 513 479 480 479
q16 515 391 395 391
q17 973 603 629 603
q18 8343 7715 7759 7715
q19 2023 1407 1370 1370
q20 660 324 329 324
q21 5185 3398 4073 3398
q22 418 343 342 342
Total cold run time: 114488 ms
Total hot run time: 41134 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4573 4475 4446 4446
q2 375 272 261 261
q3 3135 2887 2976 2887
q4 1913 1635 1643 1635
q5 5487 5503 5496 5496
q6 223 125 125 125
q7 2189 1798 1826 1798
q8 3204 3378 3425 3378
q9 8608 8596 8736 8596
q10 4092 3795 3732 3732
q11 587 487 497 487
q12 769 599 607 599
q13 17170 3166 3130 3130
q14 304 281 284 281
q15 518 493 484 484
q16 472 422 413 413
q17 1785 1502 1475 1475
q18 8099 7538 7497 7497
q19 1792 1687 1528 1528
q20 3012 1801 1776 1776
q21 4794 4624 4733 4624
q22 613 540 525 525
Total cold run time: 73714 ms
Total hot run time: 55173 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](cloud) Add profile for sync_rowsets while quering [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #35869:
URL: https://github.com/apache/doris/pull/35869#issuecomment-2147174938
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org