You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2024/09/26 07:44:06 UTC
[PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
englefly opened a new pull request, #41343:
URL: https://github.com/apache/doris/pull/41343
## Proposed changes
pick #40529
Issue Number: close #xxx
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376172946
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376302563
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 8bc977d4ccb087c765b455232a913d48aef63829 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.3 seconds inserted 10000000 Rows, about 448K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376282166
<details>
<summary>TPC-DS: <b>Total hot run time: 211398 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8bc977d4ccb087c765b455232a913d48aef63829, data reload: false
query1 1500 530 516 516
query2 6517 2500 2327 2327
query3 9086 199 198 198
query4 27834 21873 21356 21356
query5 19142 6505 6441 6441
query6 286 212 241 212
query7 3596 294 318 294
query8 254 289 238 238
query9 3079 2638 2544 2544
query10 413 289 304 289
query11 15390 14825 14891 14825
query12 130 78 75 75
query13 872 469 431 431
query14 17531 13607 13737 13607
query15 327 215 223 215
query16 6345 277 262 262
query17 1567 929 890 890
query18 850 312 317 312
query19 202 151 146 146
query20 99 100 106 100
query21 192 94 94 94
query22 5092 5029 5115 5029
query23 34067 33503 33489 33489
query24 7571 6308 6250 6250
query25 526 438 415 415
query26 1079 160 160 160
query27 2388 295 306 295
query28 5202 2225 2195 2195
query29 2788 2630 2720 2630
query30 239 168 169 168
query31 955 726 744 726
query32 63 60 61 60
query33 450 250 244 244
query34 858 478 472 472
query35 1058 933 933 933
query36 1296 1149 1004 1004
query37 121 59 58 58
query38 3049 2935 2936 2935
query39 1370 1307 1315 1307
query40 304 94 94 94
query41 40 36 37 36
query42 84 92 86 86
query43 576 613 537 537
query44 1166 706 704 704
query45 246 228 224 224
query46 1239 942 948 942
query47 1905 1750 1994 1750
query48 505 412 413 412
query49 652 378 372 372
query50 849 609 610 609
query51 4729 4710 4732 4710
query52 99 80 81 80
query53 228 188 186 186
query54 2648 2457 2468 2457
query55 89 81 87 81
query56 219 199 205 199
query57 1328 1212 1158 1158
query58 220 209 235 209
query59 3445 3090 3485 3090
query60 213 207 198 198
query61 91 89 94 89
query62 871 454 474 454
query63 203 179 177 177
query64 3632 1570 1378 1378
query65 3585 3557 3537 3537
query66 739 419 411 411
query67 15826 17072 14858 14858
query68 9683 635 620 620
query69 508 263 276 263
query70 1492 1336 1381 1336
query71 397 299 308 299
query72 6045 4903 4720 4720
query73 765 323 318 318
query74 6310 5764 5863 5764
query75 5036 3788 3658 3658
query76 5069 1151 1205 1151
query77 779 250 250 250
query78 12474 11689 11740 11689
query79 7741 628 640 628
query80 2085 377 408 377
query81 456 235 239 235
query82 1607 98 95 95
query83 167 130 133 130
query84 263 70 72 70
query85 984 322 314 314
query86 350 303 305 303
query87 3284 3021 3015 3015
query88 4716 2280 2305 2280
query89 496 293 302 293
query90 2115 218 217 217
query91 156 126 125 125
query92 61 51 53 51
query93 7525 588 578 578
query94 897 206 212 206
query95 1970 2034 1974 1974
query96 657 320 318 318
query97 6443 6383 6313 6313
query98 245 206 204 204
query99 3093 824 825 824
Total cold run time: 322984 ms
Total hot run time: 211398 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376240096
<details>
<summary>TPC-H: <b>Total hot run time: 49012 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8bc977d4ccb087c765b455232a913d48aef63829, data reload: false
------ Round 1 ----------------------------------
q1 17895 4375 4356 4356
q2 12635 155 141 141
q3 9805 1907 1915 1907
q4 10288 1260 1325 1260
q5 8403 3865 3878 3865
q6 235 124 125 124
q7 2052 1596 1610 1596
q8 9415 2710 2698 2698
q9 11617 9723 9771 9723
q10 8615 3496 3508 3496
q11 410 255 248 248
q12 472 297 297 297
q13 18371 3961 3985 3961
q14 359 337 335 335
q15 513 447 465 447
q16 522 468 450 450
q17 1132 947 931 931
q18 7196 6902 6870 6870
q19 1687 1574 1578 1574
q20 534 325 312 312
q21 4418 4107 4026 4026
q22 493 401 395 395
Total cold run time: 127067 ms
Total hot run time: 49012 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4306 4295 4285 4285
q2 321 228 221 221
q3 4139 4107 4154 4107
q4 2740 2727 2728 2727
q5 7167 7077 7132 7077
q6 236 119 119 119
q7 3185 2821 2822 2821
q8 4323 4465 4508 4465
q9 13715 13294 13600 13294
q10 4236 4232 4246 4232
q11 767 672 688 672
q12 1038 860 843 843
q13 7072 3732 3729 3729
q14 451 424 419 419
q15 494 457 463 457
q16 612 585 581 581
q17 3787 3775 3889 3775
q18 8846 8849 8750 8750
q19 1699 1682 1653 1653
q20 2390 2154 2087 2087
q21 8424 8391 8471 8391
q22 1019 930 947 930
Total cold run time: 80967 ms
Total hot run time: 75635 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376173082
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #41343:
URL: https://github.com/apache/doris/pull/41343#issuecomment-2376295464
<details>
<summary>ClickBench: <b>Total hot run time: 32.52 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8bc977d4ccb087c765b455232a913d48aef63829, data reload: false
query1 0.21 0.21 0.20
query2 0.07 0.03 0.02
query3 0.25 0.04 0.04
query4 1.81 0.07 0.07
query5 0.54 0.52 0.52
query6 1.25 0.61 0.62
query7 0.08 0.04 0.05
query8 0.03 0.02 0.03
query9 0.52 0.49 0.46
query10 0.52 0.54 0.54
query11 0.12 0.10 0.09
query12 0.13 0.09 0.10
query13 0.62 0.62 0.60
query14 0.79 0.79 0.80
query15 0.77 0.77 0.76
query16 0.58 0.57 0.56
query17 1.67 1.63 1.64
query18 0.86 0.97 0.93
query19 3.42 1.87 1.81
query20 0.02 0.02 0.03
query21 15.40 0.54 0.54
query22 1.91 2.31 1.41
query23 17.23 0.99 0.96
query24 4.46 1.18 3.17
query25 0.36 0.07 0.06
query26 0.78 0.16 0.15
query27 0.03 0.04 0.04
query28 6.36 0.77 0.76
query29 12.65 2.40 2.26
query30 0.56 0.52 0.52
query31 2.82 0.38 0.39
query32 3.40 0.49 0.49
query33 3.06 3.09 3.08
query34 15.27 4.78 4.78
query35 4.87 4.85 4.84
query36 1.08 1.01 1.02
query37 0.06 0.05 0.05
query38 0.04 0.02 0.03
query39 0.02 0.01 0.01
query40 0.16 0.14 0.15
query41 0.07 0.02 0.01
query42 0.02 0.01 0.01
query43 0.02 0.02 0.02
Total cold run time: 104.89 s
Total hot run time: 32.52 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0) [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly closed pull request #41343: [opt](nereids) tabe row count priority: user injected > BE report > analyzed (2.0)
URL: https://github.com/apache/doris/pull/41343
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org