You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "924060929 (via GitHub)" <gi...@apache.org> on 2024/03/11 11:17:49 UTC
[PR] [enhancement](Nereids) Optimize expression [doris]
924060929 opened a new pull request, #32067:
URL: https://github.com/apache/doris/pull/32067
## Proposed changes
1. optimize expression comparison
- flatter method invoke
- short circuit: if some simple field not equals, then return, and not compare to the big field, like Alias.name
2. lazy compute Alias.name by `toSql`, so that `Alias.toSlot()` will not generate long name immediately
3. cache Expresssion.inputSlots, it can save time when invoke this method multiple times
4. always compute Expression.unbound, it can avoid traverse the big expression tree
this pr can save about 200ms when submit some long sqls
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1991001028
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 3d75bded1c5c70216bbf403565539c521a234df1 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 16.0 seconds inserted 10000000 Rows, about 625K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1990996419
<details>
<summary>ClickBench: <b>Total hot run time: 29.75 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3d75bded1c5c70216bbf403565539c521a234df1, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.03 0.03
query3 0.23 0.06 0.07
query4 1.67 0.10 0.10
query5 0.52 0.48 0.51
query6 1.17 0.61 0.61
query7 0.01 0.01 0.02
query8 0.04 0.03 0.02
query9 0.56 0.49 0.50
query10 0.54 0.54 0.54
query11 0.12 0.08 0.09
query12 0.12 0.09 0.10
query13 0.57 0.55 0.56
query14 0.74 0.75 0.76
query15 0.79 0.78 0.77
query16 0.39 0.38 0.39
query17 1.04 0.98 1.00
query18 0.18 0.27 0.21
query19 1.79 1.68 1.73
query20 0.01 0.00 0.00
query21 15.40 0.54 0.56
query22 2.26 1.87 2.08
query23 17.19 0.88 0.66
query24 3.31 1.99 0.61
query25 0.16 0.06 0.04
query26 0.87 0.13 0.13
query27 0.03 0.03 0.03
query28 10.77 0.87 0.87
query29 12.73 3.13 3.16
query30 0.66 0.54 0.59
query31 2.80 0.34 0.34
query32 3.38 0.43 0.45
query33 2.72 2.81 2.80
query34 16.03 4.32 4.34
query35 4.31 4.30 4.32
query36 1.07 1.00 1.00
query37 0.07 0.05 0.05
query38 0.04 0.04 0.03
query39 0.02 0.02 0.02
query40 0.16 0.13 0.14
query41 0.07 0.02 0.02
query42 0.02 0.02 0.01
query43 0.03 0.03 0.02
Total cold run time: 104.69 s
Total hot run time: 29.75 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "starocean999 (via GitHub)" <gi...@apache.org>.
starocean999 merged PR #32067:
URL: https://github.com/apache/doris/pull/32067
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988361470
<details>
<summary>TPC-DS: <b>Total hot run time: 185157 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8d773abfe21a0e17b9b3e93cbbbfa762c735f138, data reload: false
query1 929 361 339 339
query2 7349 1909 1872 1872
query3 6707 223 212 212
query4 24166 20839 20944 20839
query5 4327 510 434 434
query6 263 175 177 175
query7 4613 314 298 298
query8 229 161 163 161
query9 8412 2261 2252 2252
query10 455 234 243 234
query11 14939 14362 14463 14362
query12 130 86 86 86
query13 1645 423 402 402
query14 10715 9739 9949 9739
query15 239 196 186 186
query16 7801 273 273 273
query17 1907 580 558 558
query18 2005 288 277 277
query19 197 161 152 152
query20 95 85 86 85
query21 199 127 123 123
query22 4629 4514 4487 4487
query23 31418 30681 30596 30596
query24 11065 3080 3055 3055
query25 617 383 386 383
query26 737 161 165 161
query27 2648 366 359 359
query28 5615 1855 1860 1855
query29 979 590 604 590
query30 309 147 149 147
query31 919 707 720 707
query32 111 58 58 58
query33 754 259 255 255
query34 1031 464 506 464
query35 835 634 616 616
query36 998 826 829 826
query37 103 79 75 75
query38 3252 3216 3177 3177
query39 1394 1358 1388 1358
query40 212 144 112 112
query41 63 63 63 63
query42 109 102 103 102
query43 423 393 404 393
query44 1082 715 708 708
query45 273 254 235 235
query46 1043 804 759 759
query47 1640 1557 1554 1554
query48 417 344 349 344
query49 1090 358 330 330
query50 792 375 379 375
query51 6594 6611 6580 6580
query52 102 100 100 100
query53 375 294 283 283
query54 296 270 258 258
query55 88 92 82 82
query56 239 243 212 212
query57 1091 1002 976 976
query58 237 215 233 215
query59 2408 2316 2164 2164
query60 263 280 269 269
query61 126 109 110 109
query62 652 418 406 406
query63 313 274 281 274
query64 4999 3341 3179 3179
query65 3042 2962 2986 2962
query66 841 326 324 324
query67 15029 14540 14238 14238
query68 9094 550 572 550
query69 615 405 381 381
query70 1316 1070 1054 1054
query71 528 274 274 274
query72 6416 2643 2491 2491
query73 1454 322 321 321
query74 6862 6508 6482 6482
query75 9633 7966 8096 7966
query76 5478 1108 1165 1108
query77 688 249 253 249
query78 10219 9618 9731 9618
query79 9202 515 511 511
query80 1218 439 367 367
query81 509 213 212 212
query82 332 194 193 193
query83 209 140 142 140
query84 285 76 73 73
query85 936 317 308 308
query86 389 275 292 275
query87 3452 3262 3197 3197
query88 3770 2356 2350 2350
query89 519 370 357 357
query90 2071 183 171 171
query91 160 126 127 126
query92 55 47 51 47
query93 5907 530 513 513
query94 1330 184 188 184
query95 450 342 340 340
query96 594 262 267 262
query97 4414 4242 4282 4242
query98 228 205 209 205
query99 1090 764 756 756
Total cold run time: 297998 ms
Total hot run time: 185157 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1990918902
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988377037
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 8d773abfe21a0e17b9b3e93cbbbfa762c735f138 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 17.4 seconds inserted 10000000 Rows, about 574K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1990988867
<details>
<summary>TPC-DS: <b>Total hot run time: 186827 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3d75bded1c5c70216bbf403565539c521a234df1, data reload: false
query1 906 366 335 335
query2 7420 1927 1928 1927
query3 6701 215 211 211
query4 31153 20705 21027 20705
query5 4322 482 413 413
query6 263 189 165 165
query7 4625 300 293 293
query8 229 164 165 164
query9 10038 2318 2295 2295
query10 452 238 230 230
query11 17192 14162 14077 14077
query12 128 112 81 81
query13 1626 410 416 410
query14 11533 10474 10283 10283
query15 309 206 196 196
query16 8058 269 261 261
query17 1925 564 531 531
query18 2083 292 275 275
query19 238 172 155 155
query20 92 88 89 88
query21 201 131 120 120
query22 4646 4442 4437 4437
query23 31599 31124 31015 31015
query24 10859 2845 2825 2825
query25 634 370 383 370
query26 1286 169 162 162
query27 2502 352 358 352
query28 7615 1889 1878 1878
query29 889 629 624 624
query30 303 147 153 147
query31 994 734 757 734
query32 96 59 54 54
query33 786 264 250 250
query34 1082 466 480 466
query35 828 603 591 591
query36 1025 872 856 856
query37 120 75 77 75
query38 3256 3260 3130 3130
query39 1407 1357 1395 1357
query40 205 109 109 109
query41 48 47 46 46
query42 101 95 100 95
query43 494 458 431 431
query44 1272 716 712 712
query45 273 272 266 266
query46 1070 717 690 690
query47 1670 1592 1604 1592
query48 445 351 379 351
query49 1125 327 322 322
query50 759 376 373 373
query51 6588 6549 6509 6509
query52 111 90 93 90
query53 335 265 274 265
query54 292 230 226 226
query55 84 79 78 78
query56 231 257 247 247
query57 1065 1000 1018 1000
query58 222 193 197 193
query59 2678 2534 2530 2530
query60 271 238 240 238
query61 104 88 87 87
query62 598 396 385 385
query63 302 275 268 268
query64 5438 3878 3841 3841
query65 3118 3003 3012 3003
query66 839 317 316 316
query67 14752 14389 14769 14389
query68 5185 518 517 517
query69 580 355 368 355
query70 1209 1165 1137 1137
query71 427 276 282 276
query72 6332 2652 2620 2620
query73 710 329 331 329
query74 6935 6581 6527 6527
query75 8910 8150 8161 8150
query76 3698 900 1041 900
query77 629 270 259 259
query78 10292 9606 9684 9606
query79 7707 520 525 520
query80 1913 409 403 403
query81 555 210 216 210
query82 1591 208 208 208
query83 320 147 152 147
query84 286 82 81 81
query85 1690 358 354 354
query86 476 296 308 296
query87 3416 3220 3216 3216
query88 5069 2406 2363 2363
query89 465 360 353 353
query90 1965 179 178 178
query91 155 126 143 126
query92 57 45 48 45
query93 5969 501 481 481
query94 1228 175 177 175
query95 435 334 321 321
query96 608 271 270 270
query97 4425 4249 4328 4249
query98 216 220 206 206
query99 1074 759 783 759
Total cold run time: 308438 ms
Total hot run time: 186827 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988205987
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1993453608
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988202001
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988339763
<details>
<summary>TPC-H: <b>Total hot run time: 38249 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8d773abfe21a0e17b9b3e93cbbbfa762c735f138, data reload: false
------ Round 1 ----------------------------------
q1 17625 4076 4033 4033
q2 2023 151 144 144
q3 10548 950 938 938
q4 4663 938 944 938
q5 7611 2861 3007 2861
q6 180 131 131 131
q7 1292 845 811 811
q8 9483 2084 2073 2073
q9 7345 6558 6525 6525
q10 8339 2601 2575 2575
q11 429 219 217 217
q12 1411 316 309 309
q13 18474 3018 3021 3018
q14 277 257 253 253
q15 515 482 471 471
q16 506 399 413 399
q17 979 917 867 867
q18 7003 6274 5851 5851
q19 1579 1536 1529 1529
q20 536 288 285 285
q21 7394 3720 3692 3692
q22 789 343 329 329
Total cold run time: 109001 ms
Total hot run time: 38249 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4015 4004 4197 4004
q2 319 217 224 217
q3 2994 3133 3113 3113
q4 1928 1923 1877 1877
q5 5405 5408 5428 5408
q6 211 118 117 117
q7 2402 1963 1944 1944
q8 3257 3313 3311 3311
q9 8651 8602 8587 8587
q10 6127 3712 3697 3697
q11 536 450 440 440
q12 689 543 518 518
q13 7232 2822 2813 2813
q14 271 236 266 236
q15 480 449 449 449
q16 445 406 416 406
q17 1698 1658 1668 1658
q18 7934 7522 7292 7292
q19 1702 1610 1625 1610
q20 1931 1693 1681 1681
q21 4866 4803 4736 4736
q22 496 435 443 435
Total cold run time: 63589 ms
Total hot run time: 54549 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988291079
<details>
<summary>TPC-H: <b>Total hot run time: 37811 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c03dca07bcced33f31f833dd3baeccfe16c243ac, data reload: false
------ Round 1 ----------------------------------
q1 17708 4010 3962 3962
q2 2014 149 142 142
q3 10554 921 915 915
q4 4660 926 917 917
q5 7613 2870 2954 2870
q6 176 124 123 123
q7 1290 823 806 806
q8 9473 2092 2065 2065
q9 7277 6496 6518 6496
q10 8204 2569 2541 2541
q11 417 211 213 211
q12 786 313 311 311
q13 18046 2993 2967 2967
q14 281 260 251 251
q15 493 453 452 452
q16 468 381 396 381
q17 931 818 800 800
q18 6691 5872 5905 5872
q19 1560 1510 1508 1508
q20 533 278 279 278
q21 7571 3641 3658 3641
q22 827 302 308 302
Total cold run time: 107573 ms
Total hot run time: 37811 ms
----- Round 2, with runtime_filter_mode=off -----
q1 3960 3951 3950 3950
q2 323 230 228 228
q3 2945 2944 2890 2890
q4 1805 1816 1805 1805
q5 5217 5253 5194 5194
q6 216 114 116 114
q7 2239 1832 1829 1829
q8 3180 3254 3230 3230
q9 8497 8488 8513 8488
q10 6130 3703 3704 3703
q11 528 439 454 439
q12 704 547 526 526
q13 10897 2852 2820 2820
q14 268 245 250 245
q15 484 457 449 449
q16 450 415 395 395
q17 1685 1633 1624 1624
q18 7790 7401 7258 7258
q19 1952 1551 1590 1551
q20 1847 1686 1688 1686
q21 4872 4739 4721 4721
q22 494 447 441 441
Total cold run time: 66483 ms
Total hot run time: 53586 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988307824
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1993453546
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1990972748
<details>
<summary>TPC-H: <b>Total hot run time: 36333 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3d75bded1c5c70216bbf403565539c521a234df1, data reload: false
------ Round 1 ----------------------------------
q1 17623 4121 4112 4112
q2 2032 151 144 144
q3 10569 913 883 883
q4 4650 647 683 647
q5 7608 2706 2741 2706
q6 185 127 129 127
q7 1171 814 797 797
q8 9470 1983 2043 1983
q9 7370 6495 6412 6412
q10 8271 2503 2471 2471
q11 429 227 207 207
q12 806 300 279 279
q13 17959 3010 3004 3004
q14 277 275 249 249
q15 498 446 442 442
q16 501 385 395 385
q17 926 571 534 534
q18 6671 5824 5732 5732
q19 1543 1477 1392 1392
q20 535 269 275 269
q21 7342 3288 3259 3259
q22 796 299 326 299
Total cold run time: 107232 ms
Total hot run time: 36333 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4107 4049 4121 4049
q2 318 233 224 224
q3 2952 2835 2841 2835
q4 1821 1467 1525 1467
q5 5153 5193 5225 5193
q6 192 115 120 115
q7 2224 1861 1826 1826
q8 3135 3251 3282 3251
q9 8523 8500 8482 8482
q10 6161 3703 3640 3640
q11 536 445 435 435
q12 736 548 562 548
q13 13564 2861 2841 2841
q14 272 248 251 248
q15 482 448 437 437
q16 447 389 397 389
q17 1714 1480 1470 1470
q18 7629 7188 7096 7096
q19 5904 1562 1557 1557
q20 1904 1688 1697 1688
q21 4750 4589 4624 4589
q22 534 445 449 445
Total cold run time: 73058 ms
Total hot run time: 52825 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](Nereids) Optimize expression [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32067:
URL: https://github.com/apache/doris/pull/32067#issuecomment-1988371242
<details>
<summary>ClickBench: <b>Total hot run time: 30.28 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8d773abfe21a0e17b9b3e93cbbbfa762c735f138, data reload: false
query1 0.03 0.03 0.03
query2 0.06 0.03 0.03
query3 0.24 0.06 0.06
query4 1.67 0.10 0.09
query5 0.49 0.49 0.49
query6 1.36 0.65 0.67
query7 0.02 0.02 0.01
query8 0.04 0.03 0.03
query9 0.57 0.52 0.50
query10 0.55 0.57 0.56
query11 0.13 0.10 0.10
query12 0.13 0.10 0.10
query13 0.58 0.58 0.57
query14 0.74 0.76 0.75
query15 0.82 0.81 0.78
query16 0.36 0.37 0.38
query17 0.98 0.95 0.98
query18 0.26 0.26 0.24
query19 1.80 1.71 1.66
query20 0.02 0.01 0.01
query21 15.40 0.64 0.62
query22 3.69 3.13 2.22
query23 17.75 1.10 1.01
query24 2.13 0.20 0.36
query25 0.30 0.06 0.04
query26 0.20 0.14 0.15
query27 0.04 0.04 0.03
query28 12.54 0.83 0.82
query29 12.76 3.32 3.26
query30 0.61 0.56 0.52
query31 2.80 0.34 0.34
query32 3.38 0.44 0.43
query33 2.82 2.83 2.81
query34 15.51 4.28 4.34
query35 4.31 4.30 4.29
query36 1.08 1.01 1.02
query37 0.07 0.05 0.05
query38 0.04 0.04 0.04
query39 0.03 0.02 0.01
query40 0.17 0.14 0.13
query41 0.07 0.02 0.02
query42 0.03 0.02 0.01
query43 0.03 0.03 0.02
Total cold run time: 106.61 s
Total hot run time: 30.28 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org