You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zclllyybb (via GitHub)" <gi...@apache.org> on 2024/02/23 03:15:57 UTC
[PR] [fix](compile) Fix performance compile fail [doris]
zclllyybb opened a new pull request, #31305:
URL: https://github.com/apache/doris/pull/31305
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960677325
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960822238
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960741406
<details>
<summary>ClickBench: <b>Total hot run time: 31.69 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0039f86a782977308bb3aa62b241e2e15d0c6e21, data reload: false
query1 0.02 0.02 0.02
query2 0.06 0.02 0.02
query3 0.24 0.08 0.08
query4 1.64 0.08 0.07
query5 0.49 0.49 0.50
query6 1.29 0.62 0.62
query7 0.02 0.01 0.01
query8 0.03 0.02 0.03
query9 0.54 0.45 0.46
query10 0.48 0.50 0.50
query11 0.12 0.09 0.09
query12 0.12 0.10 0.10
query13 0.59 0.59 0.60
query14 0.77 0.79 0.80
query15 0.83 0.79 0.81
query16 0.33 0.34 0.33
query17 0.89 0.93 0.94
query18 0.20 0.19 0.18
query19 1.82 1.69 1.73
query20 0.01 0.02 0.01
query21 15.40 0.64 0.59
query22 3.24 4.26 3.11
query23 17.49 1.01 0.92
query24 2.07 0.36 0.18
query25 0.55 0.07 0.06
query26 0.16 0.15 0.15
query27 0.07 0.06 0.06
query28 12.40 0.84 0.82
query29 12.49 3.31 3.30
query30 0.52 0.49 0.50
query31 2.77 0.37 0.36
query32 3.35 0.48 0.47
query33 3.16 3.14 3.19
query34 15.38 4.52 4.52
query35 4.49 4.51 4.51
query36 1.08 0.96 0.97
query37 0.07 0.05 0.06
query38 0.04 0.03 0.02
query39 0.02 0.01 0.01
query40 0.17 0.14 0.15
query41 0.08 0.01 0.01
query42 0.02 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.53 s
Total hot run time: 31.69 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #31305:
URL: https://github.com/apache/doris/pull/31305
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960691881
TeamCity be ut coverage result:
Function Coverage: 35.71% (8547/23936)
Line Coverage: 27.53% (69360/251946)
Region Coverage: 26.68% (35978/134833)
Branch Coverage: 23.49% (18389/78296)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b2b3a35e94ac22bb9a0664486c3fb58bdd7be2eb_b2b3a35e94ac22bb9a0664486c3fb58bdd7be2eb/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960719299
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960679637
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960679657
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960714730
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960738398
<details>
<summary>TPC-DS: <b>Total hot run time: 176127 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0039f86a782977308bb3aa62b241e2e15d0c6e21, data reload: false
query1 923 356 337 337
query2 6531 1797 1656 1656
query3 6690 201 201 201
query4 23228 21236 21046 21046
query5 4329 379 376 376
query6 255 164 161 161
query7 4598 301 295 295
query8 243 189 195 189
query9 8421 2795 2781 2781
query10 428 215 231 215
query11 15156 14570 14502 14502
query12 147 84 85 84
query13 1684 413 418 413
query14 9075 7637 7653 7637
query15 224 191 192 191
query16 7444 259 255 255
query17 1401 547 533 533
query18 1949 269 258 258
query19 188 144 149 144
query20 86 80 83 80
query21 192 115 122 115
query22 5021 4801 4680 4680
query23 32501 31481 31521 31481
query24 12758 3399 3445 3399
query25 643 359 355 355
query26 1887 159 170 159
query27 3039 329 315 315
query28 6628 1798 1784 1784
query29 1147 619 619 619
query30 276 140 145 140
query31 926 744 758 744
query32 97 57 57 57
query33 717 247 227 227
query34 1074 485 500 485
query35 944 843 806 806
query36 1014 880 897 880
query37 171 60 62 60
query38 3301 3189 3170 3170
query39 1362 1322 1316 1316
query40 285 107 107 107
query41 39 35 35 35
query42 104 101 100 100
query43 475 437 436 436
query44 1071 676 692 676
query45 196 180 172 172
query46 1026 793 740 740
query47 1668 1605 1561 1561
query48 415 339 346 339
query49 1218 300 299 299
query50 771 374 378 374
query51 4456 4316 4266 4266
query52 104 99 90 90
query53 395 308 311 308
query54 297 228 225 225
query55 80 71 77 71
query56 230 202 199 199
query57 1085 930 927 927
query58 215 195 190 190
query59 2255 2132 2035 2035
query60 244 217 210 210
query61 84 89 82 82
query62 589 393 364 364
query63 324 294 285 285
query64 6431 3074 3107 3074
query65 3302 3255 3253 3253
query66 1331 328 318 318
query67 14658 14594 14081 14081
query68 5020 562 545 545
query69 510 356 354 354
query70 1257 1226 1252 1226
query71 410 253 253 253
query72 6294 2769 2620 2620
query73 690 312 317 312
query74 6834 6492 6470 6470
query75 3211 2568 2554 2554
query76 3347 1110 1209 1110
query77 338 237 230 230
query78 9371 8849 8788 8788
query79 979 525 503 503
query80 503 356 347 347
query81 436 210 202 202
query82 160 87 86 86
query83 135 117 114 114
query84 222 80 77 77
query85 1024 338 337 337
query86 291 304 317 304
query87 3446 3262 3322 3262
query88 2735 2345 2344 2344
query89 437 363 364 363
query90 1902 165 165 165
query91 152 126 125 125
query92 53 49 49 49
query93 999 517 503 503
query94 1102 183 179 179
query95 440 336 344 336
query96 637 266 266 266
query97 4464 4295 4222 4222
query98 245 209 204 204
query99 1096 714 726 714
Total cold run time: 268786 ms
Total hot run time: 176127 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960732116
TeamCity be ut coverage result:
Function Coverage: 35.71% (8548/23936)
Line Coverage: 27.54% (69382/251948)
Region Coverage: 26.68% (35979/134833)
Branch Coverage: 23.50% (18396/78296)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0039f86a782977308bb3aa62b241e2e15d0c6e21_0039f86a782977308bb3aa62b241e2e15d0c6e21/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960743241
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 0039f86a782977308bb3aa62b241e2e15d0c6e21 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.4 seconds inserted 10000000 Rows, about 746K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960682303
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960676882
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](compile) Fix performance compile fail [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31305:
URL: https://github.com/apache/doris/pull/31305#issuecomment-1960732106
<details>
<summary>TPC-H: <b>Total hot run time: 40912 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0039f86a782977308bb3aa62b241e2e15d0c6e21, data reload: false
------ Round 1 ----------------------------------
q1 17668 4965 4841 4841
q2 2039 141 132 132
q3 10582 999 985 985
q4 4650 972 998 972
q5 7587 3150 3193 3150
q6 192 138 137 137
q7 1255 776 754 754
q8 9244 2020 2045 2020
q9 7460 6542 6549 6542
q10 8306 2644 2645 2644
q11 415 208 218 208
q12 716 328 333 328
q13 17915 3618 3629 3618
q14 292 257 249 249
q15 588 511 505 505
q16 471 405 411 405
q17 926 848 858 848
q18 7534 6806 6584 6584
q19 1557 1488 1473 1473
q20 557 277 281 277
q21 6567 3907 3948 3907
q22 870 345 333 333
Total cold run time: 107391 ms
Total hot run time: 40912 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4822 4844 4827 4827
q2 292 183 185 183
q3 3600 3582 3600 3582
q4 2525 2523 2524 2523
q5 5771 5732 5758 5732
q6 208 129 130 129
q7 2228 1677 1639 1639
q8 3005 3042 3070 3042
q9 8738 8666 8714 8666
q10 6787 4241 4237 4237
q11 514 369 379 369
q12 765 541 549 541
q13 4507 3449 3482 3449
q14 256 253 241 241
q15 629 497 499 497
q16 471 430 426 426
q17 1674 1616 1605 1605
q18 8331 7703 7624 7624
q19 1629 1629 1625 1625
q20 2104 1836 1825 1825
q21 6536 6199 6104 6104
q22 577 523 491 491
Total cold run time: 65969 ms
Total hot run time: 59357 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org