You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hello-stephen (via GitHub)" <gi...@apache.org> on 2024/01/19 12:04:14 UTC
[PR] [ci](perf) add required [doris]
hello-stephen opened a new pull request, #30155:
URL: https://github.com/apache/doris/pull/30155
1. set performance pipeline to required
2. rm unused files
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900294847
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900360310
<details>
<summary>ClickBench: <b>Total hot run time: 30.77 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.03
query3 0.23 0.05 0.05
query4 1.69 0.07 0.07
query5 0.54 0.53 0.52
query6 1.29 0.62 0.64
query7 0.02 0.01 0.01
query8 0.04 0.02 0.02
query9 0.55 0.51 0.51
query10 0.56 0.56 0.56
query11 0.11 0.09 0.08
query12 0.10 0.09 0.09
query13 0.61 0.60 0.59
query14 0.79 0.81 0.80
query15 0.78 0.78 0.76
query16 0.36 0.36 0.36
query17 1.02 1.01 1.02
query18 0.23 0.26 0.24
query19 1.90 1.74 1.78
query20 0.01 0.01 0.01
query21 15.42 0.57 0.57
query22 2.90 2.61 1.96
query23 16.95 0.81 0.81
query24 2.36 1.55 0.66
query25 0.36 0.13 0.14
query26 0.68 0.12 0.14
query27 0.08 0.05 0.05
query28 11.62 0.77 0.75
query29 12.54 3.21 3.24
query30 0.51 0.47 0.53
query31 2.79 0.34 0.34
query32 3.38 0.48 0.49
query33 3.19 3.23 3.24
query34 15.82 4.31 4.34
query35 4.46 4.27 4.27
query36 1.13 1.07 1.09
query37 0.06 0.05 0.05
query38 0.04 0.02 0.03
query39 0.02 0.01 0.02
query40 0.16 0.13 0.16
query41 0.07 0.02 0.02
query42 0.02 0.02 0.01
query43 0.02 0.02 0.02
Total cold run time: 105.5 s
Total hot run time: 30.77 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900352512
<details>
<summary>TPC-DS: <b>Total hot run time: 177024 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab, data reload: false
query1 931 345 330 330
query2 6564 2094 1823 1823
query3 6693 201 197 197
query4 32424 22173 22181 22173
query5 6896 519 595 519
query6 244 154 152 152
query7 4602 258 253 253
query8 222 174 185 174
query9 8395 2545 2521 2521
query10 434 255 243 243
query11 16954 15564 15589 15564
query12 122 69 67 67
query13 1680 379 397 379
query14 10616 6960 6866 6866
query15 215 178 180 178
query16 4604 232 229 229
query17 990 471 463 463
query18 1773 245 253 245
query19 175 131 131 131
query20 74 73 70 70
query21 188 134 116 116
query22 5081 5070 4894 4894
query23 31845 30931 30909 30909
query24 6470 2824 2880 2824
query25 403 309 323 309
query26 718 141 140 140
query27 2265 269 267 267
query28 3909 1832 1827 1827
query29 922 634 624 624
query30 201 136 140 136
query31 924 749 745 745
query32 62 49 56 49
query33 421 213 205 205
query34 818 444 455 444
query35 862 778 783 778
query36 1335 1198 1292 1198
query37 89 58 56 56
query38 3362 3255 3203 3203
query39 1317 1263 1257 1257
query40 199 85 83 83
query41 36 35 33 33
query42 91 77 84 77
query43 529 473 477 473
query44 1025 674 684 674
query45 196 177 171 171
query46 1031 655 652 652
query47 1606 1579 1578 1578
query48 391 293 304 293
query49 618 277 287 277
query50 670 317 318 317
query51 5297 5228 5175 5175
query52 94 83 78 78
query53 330 271 259 259
query54 427 280 285 280
query55 77 77 79 77
query56 180 162 163 162
query57 947 943 938 938
query58 181 164 165 164
query59 2901 2685 2645 2645
query60 206 179 183 179
query61 90 84 83 83
query62 438 356 346 346
query63 285 264 256 256
query64 2570 1765 1745 1745
query65 3316 3266 3232 3232
query66 1041 314 317 314
query67 15581 15539 15170 15170
query68 11205 526 513 513
query69 619 306 297 297
query70 1638 1482 1520 1482
query71 497 223 210 210
query72 4912 2793 2829 2793
query73 2177 315 314 314
query74 6910 6313 6306 6306
query75 4833 2314 2315 2314
query76 6416 1071 1068 1068
query77 671 229 235 229
query78 9651 8919 8698 8698
query79 994 483 496 483
query80 594 325 318 318
query81 469 203 199 199
query82 180 81 80 80
query83 134 114 122 114
query84 277 66 66 66
query85 1065 336 332 332
query86 404 371 380 371
query87 3526 3376 3324 3324
query88 2840 2180 2179 2179
query89 411 365 351 351
query90 2229 187 187 187
query91 166 136 135 135
query92 52 47 41 41
query93 975 442 413 413
query94 1336 157 160 157
query95 483 451 450 450
query96 613 316 319 316
query97 4285 4121 4172 4121
query98 210 197 176 176
query99 1038 699 698 698
Total cold run time: 277963 ms
Total hot run time: 177024 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900418002
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900394862
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900394803
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900337649
<details>
<summary>TPC-H: <b>Total hot run time: 38565 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab, data reload: false
------ Round 1 ----------------------------------
q1 17650 5455 5135 5135
q2 2038 150 130 130
q3 10760 1140 1133 1133
q4 10329 743 859 743
q5 7736 3165 3085 3085
q6 196 121 119 119
q7 850 491 469 469
q8 9241 1909 1940 1909
q9 7235 6369 6356 6356
q10 8188 3046 2990 2990
q11 431 217 209 209
q12 351 191 186 186
q13 18201 3406 3353 3353
q14 246 212 205 205
q15 545 504 511 504
q16 419 366 370 366
q17 926 497 541 497
q18 7351 7055 6789 6789
q19 1848 1371 1449 1371
q20 559 305 291 291
q21 2810 2422 2429 2422
q22 364 303 330 303
Total cold run time: 108274 ms
Total hot run time: 38565 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5467 5335 5328 5328
q2 331 216 217 216
q3 3386 3229 3244 3229
q4 2094 2067 2092 2067
q5 6110 5948 5929 5929
q6 204 114 115 114
q7 2414 1979 1908 1908
q8 3264 3384 3431 3384
q9 9248 9004 9204 9004
q10 4052 4014 4220 4014
q11 580 482 485 482
q12 857 674 667 667
q13 18732 3268 3171 3171
q14 287 265 263 263
q15 562 501 499 499
q16 508 460 471 460
q17 1916 1845 1840 1840
q18 9654 18629 9464 9464
q19 25127 1531 1536 1531
q20 4583 1919 1927 1919
q21 14431 5491 5475 5475
q22 985 523 551 523
Total cold run time: 114792 ms
Total hot run time: 61487 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30155:
URL: https://github.com/apache/doris/pull/30155#issuecomment-1900364335
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 14.8 seconds inserted 10000000 Rows, about 675K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [ci](perf) add required [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 merged PR #30155:
URL: https://github.com/apache/doris/pull/30155
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org