You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2024/02/01 03:08:14 UTC
[PR] [pick](branch-2.0)do not check invisible column stats #27201 [doris]
englefly opened a new pull request, #30676:
URL: https://github.com/apache/doris/pull/30676
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1920609151
<details>
<summary>TPC-DS: <b>Total hot run time: 237995 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388, data reload: false
query1 917 389 386 386
query2 6517 2279 2023 2023
query3 6938 209 213 209
query4 19896 17924 17957 17924
query5 19719 6236 6285 6236
query6 281 208 225 208
query7 4154 303 303 303
query8 236 278 215 215
query9 3027 2625 2572 2572
query10 407 284 308 284
query11 11298 10729 10767 10729
query12 124 80 75 75
query13 5645 634 628 628
query14 17906 13455 13343 13343
query15 404 238 229 229
query16 6449 267 265 265
query17 3234 864 864 864
query18 2271 414 415 414
query19 209 150 144 144
query20 77 75 74 74
query21 194 97 93 93
query22 5331 5032 5073 5032
query23 32559 32152 31845 31845
query24 6934 6494 6497 6494
query25 539 419 432 419
query26 528 169 162 162
query27 1831 290 294 290
query28 6074 2224 2170 2170
query29 2899 2736 2733 2733
query30 240 163 162 162
query31 900 739 731 731
query32 64 60 63 60
query33 394 254 260 254
query34 834 459 480 459
query35 1144 943 924 924
query36 1564 1451 1473 1451
query37 96 60 60 60
query38 3114 2937 2932 2932
query39 1358 1325 1313 1313
query40 211 97 97 97
query41 35 32 35 32
query42 90 82 84 82
query43 600 619 584 584
query44 1119 713 722 713
query45 246 234 229 229
query46 1257 948 993 948
query47 1995 2012 1743 1743
query48 981 687 670 670
query49 613 366 369 366
query50 846 645 604 604
query51 5609 5518 5458 5458
query52 81 88 71 71
query53 441 318 311 311
query54 2429 2249 2240 2240
query55 77 72 86 72
query56 228 210 202 202
query57 1148 1201 1138 1138
query58 211 193 211 193
query59 3475 3254 3423 3254
query60 207 185 209 185
query61 91 95 85 85
query62 808 486 530 486
query63 475 337 338 337
query64 1999 1340 1341 1340
query65 3700 3635 3605 3605
query66 832 374 369 369
query67 16442 17741 15160 15160
query68 6852 656 671 656
query69 580 359 359 359
query70 1996 2044 1706 1706
query71 403 291 321 291
query72 4615 3324 3378 3324
query73 712 322 328 322
query74 6322 5892 5894 5892
query75 4288 3555 3543 3543
query76 4447 1206 1203 1203
query77 528 253 250 250
query78 31251 48852 47309 47309
query79 16350 649 671 649
query80 5129 406 397 397
query81 558 233 226 226
query82 1165 97 94 94
query83 413 150 137 137
query84 257 71 71 71
query85 2582 290 286 286
query86 483 364 384 364
query87 3248 3008 3013 3008
query88 6801 2369 2342 2342
query89 450 266 288 266
query90 2481 203 214 203
query91 173 127 126 126
query92 67 53 53 53
query93 5922 626 605 605
query94 1868 212 218 212
query95 1133 1105 1059 1059
query96 641 333 325 325
query97 6549 6397 6364 6364
query98 195 180 177 177
query99 3941 893 926 893
Total cold run time: 344952 ms
Total hot run time: 237995 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1920615545
<details>
<summary>ClickBench: <b>Total hot run time: 31.27 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.02
query3 0.24 0.04 0.05
query4 1.82 0.07 0.08
query5 0.53 0.53 0.52
query6 1.24 0.60 0.60
query7 0.01 0.01 0.00
query8 0.02 0.02 0.03
query9 0.52 0.49 0.50
query10 0.55 0.52 0.54
query11 0.11 0.09 0.08
query12 0.11 0.09 0.09
query13 0.62 0.61 0.61
query14 0.79 0.78 0.77
query15 0.78 0.76 0.77
query16 0.36 0.37 0.36
query17 1.02 1.01 1.01
query18 0.23 0.25 0.26
query19 1.88 1.85 1.89
query20 0.01 0.01 0.01
query21 15.45 0.59 0.57
query22 2.00 2.45 1.67
query23 17.18 1.05 1.09
query24 7.22 1.49 1.10
query25 1.49 0.11 0.11
query26 0.39 0.15 0.14
query27 0.10 0.11 0.11
query28 6.52 0.72 0.72
query29 12.69 2.42 2.28
query30 0.58 0.52 0.52
query31 2.81 0.38 0.38
query32 3.42 0.51 0.49
query33 3.06 3.12 3.11
query34 15.32 4.86 4.82
query35 4.90 4.85 4.87
query36 1.05 1.01 1.01
query37 0.06 0.04 0.05
query38 0.04 0.02 0.02
query39 0.01 0.01 0.01
query40 0.16 0.15 0.14
query41 0.06 0.01 0.01
query42 0.02 0.02 0.02
query43 0.03 0.01 0.02
Total cold run time: 105.49 s
Total hot run time: 31.27 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](branch-2.0)do not check invisible column stats #27201 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1920416588
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1920565683
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1921304886
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.6 seconds inserted 10000000 Rows, about 462K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1922735551
<details>
<summary>TPC-DS: <b>Total hot run time: 244155 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0d0025502b5974302d8e72c5c1f62aca3bee2dac, data reload: false
query1 922 394 381 381
query2 6536 2335 1955 1955
query3 6913 202 203 202
query4 20876 17973 17848 17848
query5 19721 6278 6208 6208
query6 283 210 212 210
query7 4159 304 297 297
query8 243 243 244 243
query9 3090 2680 2616 2616
query10 405 320 307 307
query11 11208 10643 10631 10631
query12 125 70 72 70
query13 5653 652 654 652
query14 17468 13413 13339 13339
query15 351 241 247 241
query16 6441 260 263 260
query17 3192 895 862 862
query18 2275 413 401 401
query19 209 149 144 144
query20 72 75 79 75
query21 186 97 97 97
query22 5386 5166 5064 5064
query23 32495 32303 31945 31945
query24 6986 6479 6495 6479
query25 530 453 415 415
query26 533 167 160 160
query27 1902 296 289 289
query28 6134 2265 2205 2205
query29 2888 2822 2762 2762
query30 242 158 163 158
query31 884 724 741 724
query32 65 56 55 55
query33 394 249 243 243
query34 847 481 486 481
query35 1136 939 932 932
query36 1712 1459 1379 1379
query37 92 61 57 57
query38 3110 2923 2930 2923
query39 1368 1359 1336 1336
query40 203 95 93 93
query41 34 32 31 31
query42 93 88 75 75
query43 694 582 578 578
query44 1135 710 713 710
query45 242 232 229 229
query46 1261 976 970 970
query47 1806 1844 1609 1609
query48 1000 699 703 699
query49 613 369 363 363
query50 871 590 603 590
query51 5585 5568 5474 5474
query52 89 76 78 76
query53 440 324 321 321
query54 2424 2233 2250 2233
query55 94 73 78 73
query56 232 201 182 182
query57 1106 1174 1148 1148
query58 208 184 213 184
query59 3552 3291 3182 3182
query60 199 197 216 197
query61 88 88 89 88
query62 720 477 579 477
query63 477 341 346 341
query64 2006 1279 1296 1279
query65 3665 3621 3601 3601
query66 835 370 359 359
query67 16248 15833 15638 15638
query68 8779 637 679 637
query69 561 340 339 339
query70 2025 1881 1752 1752
query71 380 319 304 304
query72 4628 3336 3353 3336
query73 711 319 323 319
query74 6264 5785 5913 5785
query75 4750 3506 3505 3505
query76 5538 1185 1208 1185
query77 919 255 255 255
query78 32538 53600 53546 53546
query79 15691 646 621 621
query80 4993 384 381 381
query81 558 227 234 227
query82 1695 100 93 93
query83 325 136 137 136
query84 258 69 69 69
query85 1937 287 290 287
query86 485 388 374 374
query87 3240 3006 3010 3006
query88 7351 2340 2322 2322
query89 465 311 291 291
query90 2486 211 212 211
query91 154 122 116 116
query92 62 49 47 47
query93 6583 571 605 571
query94 1836 204 210 204
query95 1103 1069 1035 1035
query96 636 331 324 324
query97 6591 6401 6416 6401
query98 178 170 166 166
query99 3810 883 864 864
Total cold run time: 350482 ms
Total hot run time: 244155 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #30676:
URL: https://github.com/apache/doris/pull/30676
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1920582517
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1921189771
run performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1922691730
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1920594440
<details>
<summary>TPC-H: <b>Total hot run time: 50010 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388, data reload: false
------ Round 1 ----------------------------------
q1 17792 4404 4316 4316
q2 2038 146 141 141
q3 10319 1874 1904 1874
q4 10338 1273 1325 1273
q5 8524 3986 3970 3970
q6 223 122 120 120
q7 2012 1578 1588 1578
q8 9322 2709 2705 2705
q9 11177 10716 10604 10604
q10 8668 3516 3536 3516
q11 414 254 242 242
q12 459 290 297 290
q13 18360 3920 4016 3920
q14 350 324 326 324
q15 517 448 453 448
q16 708 586 591 586
q17 1119 951 966 951
q18 7218 6855 6780 6780
q19 1677 1557 1607 1557
q20 524 318 295 295
q21 4454 4116 4150 4116
q22 488 413 404 404
Total cold run time: 116701 ms
Total hot run time: 50010 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4296 4298 4310 4298
q2 320 224 220 220
q3 4172 4167 4162 4162
q4 2732 2742 2744 2742
q5 7306 7244 7203 7203
q6 235 122 121 121
q7 3212 2835 2856 2835
q8 4419 4444 4483 4444
q9 17632 17408 17178 17178
q10 4243 4291 4311 4291
q11 759 674 668 668
q12 1026 873 844 844
q13 6889 3766 3782 3766
q14 445 426 431 426
q15 498 471 451 451
q16 759 700 704 700
q17 3919 3858 3896 3858
q18 8838 8958 8792 8792
q19 1675 1699 1647 1647
q20 2369 2160 2113 2113
q21 8502 8515 8488 8488
q22 1002 951 984 951
Total cold run time: 85248 ms
Total hot run time: 80198 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1921264332
<details>
<summary>TPC-H: <b>Total hot run time: 49609 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388, data reload: false
------ Round 1 ----------------------------------
q1 17719 4412 4342 4342
q2 2024 148 139 139
q3 10327 1904 1935 1904
q4 10324 1244 1263 1244
q5 8475 3889 3982 3889
q6 228 120 121 120
q7 2015 1584 1608 1584
q8 9320 2694 2711 2694
q9 10574 10377 10594 10377
q10 8606 3437 3462 3437
q11 423 252 238 238
q12 460 301 304 301
q13 18358 3962 4013 3962
q14 348 325 316 316
q15 512 456 456 456
q16 688 589 595 589
q17 1112 985 967 967
q18 7339 6833 6972 6833
q19 1657 1540 1496 1496
q20 534 309 288 288
q21 4383 4094 4058 4058
q22 504 375 389 375
Total cold run time: 115930 ms
Total hot run time: 49609 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4309 4281 4271 4271
q2 317 225 220 220
q3 4139 4144 4144 4144
q4 2755 2735 2756 2735
q5 7258 7105 7150 7105
q6 234 116 115 115
q7 3224 2779 2833 2779
q8 4416 4452 4471 4452
q9 17054 16901 16895 16895
q10 4178 4264 4221 4221
q11 772 686 653 653
q12 1004 860 861 860
q13 6820 3763 3782 3763
q14 451 430 414 414
q15 505 450 450 450
q16 761 692 714 692
q17 3809 3817 3823 3817
q18 8924 8840 8749 8749
q19 1700 1709 1620 1620
q20 2406 2167 2102 2102
q21 8545 8434 8490 8434
q22 1066 994 937 937
Total cold run time: 84647 ms
Total hot run time: 79428 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1921299397
<details>
<summary>ClickBench: <b>Total hot run time: 30.86 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388, data reload: false
query1 0.02 0.02 0.03
query2 0.05 0.02 0.02
query3 0.25 0.04 0.05
query4 1.83 0.07 0.07
query5 0.53 0.53 0.52
query6 1.28 0.61 0.62
query7 0.01 0.01 0.01
query8 0.03 0.03 0.02
query9 0.50 0.47 0.49
query10 0.55 0.53 0.53
query11 0.11 0.09 0.10
query12 0.11 0.08 0.09
query13 0.61 0.62 0.63
query14 0.76 0.81 0.78
query15 0.78 0.77 0.77
query16 0.35 0.37 0.38
query17 1.03 1.04 1.01
query18 0.24 0.25 0.24
query19 1.89 1.82 1.84
query20 0.01 0.00 0.01
query21 15.47 0.55 0.54
query22 2.25 1.82 2.02
query23 17.74 1.03 0.77
query24 3.67 0.90 1.29
query25 1.46 0.12 0.11
query26 0.22 0.13 0.13
query27 0.11 0.11 0.11
query28 9.46 0.72 0.73
query29 12.65 2.35 2.34
query30 0.62 0.52 0.51
query31 2.81 0.37 0.40
query32 3.42 0.50 0.49
query33 3.13 3.08 3.09
query34 15.28 4.78 4.79
query35 4.81 4.85 4.82
query36 1.08 1.02 1.02
query37 0.06 0.05 0.05
query38 0.03 0.02 0.02
query39 0.01 0.02 0.01
query40 0.15 0.13 0.14
query41 0.07 0.02 0.01
query42 0.01 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.47 s
Total hot run time: 30.86 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1921289680
<details>
<summary>TPC-DS: <b>Total hot run time: 238131 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388, data reload: false
query1 915 390 377 377
query2 6514 2033 1986 1986
query3 6914 208 203 203
query4 19836 17731 17852 17731
query5 19720 6274 6228 6228
query6 288 217 219 217
query7 4149 295 293 293
query8 252 238 232 232
query9 3054 2671 2592 2592
query10 407 288 292 288
query11 11201 10576 10666 10576
query12 119 77 67 67
query13 5645 688 650 650
query14 17567 13220 13270 13220
query15 374 259 222 222
query16 6449 266 281 266
query17 3189 860 865 860
query18 2290 415 397 397
query19 203 142 145 142
query20 77 75 73 73
query21 185 94 95 94
query22 5221 5036 5071 5036
query23 32617 31711 31961 31711
query24 7032 6545 6480 6480
query25 527 430 440 430
query26 528 153 158 153
query27 1947 291 296 291
query28 6147 2243 2197 2197
query29 3049 2775 2748 2748
query30 242 161 167 161
query31 904 722 744 722
query32 64 58 54 54
query33 391 249 235 235
query34 850 472 484 472
query35 1126 916 903 903
query36 1771 1469 1603 1469
query37 85 60 57 57
query38 3090 2973 2901 2901
query39 1380 1323 1321 1321
query40 194 93 95 93
query41 35 32 32 32
query42 80 90 84 84
query43 597 549 604 549
query44 1106 718 704 704
query45 240 234 225 225
query46 1242 978 980 978
query47 2073 1855 1995 1855
query48 977 683 656 656
query49 611 370 361 361
query50 872 587 603 587
query51 5875 5686 5829 5686
query52 95 102 107 102
query53 451 332 328 328
query54 2453 2337 2315 2315
query55 105 82 77 77
query56 247 251 216 216
query57 1237 1150 1163 1150
query58 236 225 217 217
query59 3790 3578 3425 3425
query60 202 205 199 199
query61 86 87 84 84
query62 833 463 490 463
query63 483 344 341 341
query64 2065 1334 1326 1326
query65 3754 3695 3727 3695
query66 2015 386 381 381
query67 15987 15429 15209 15209
query68 8680 653 663 653
query69 570 338 354 338
query70 2107 1905 1775 1775
query71 400 293 308 293
query72 4523 3344 3333 3333
query73 714 324 315 315
query74 6267 5867 5818 5818
query75 4853 3458 3473 3458
query76 5250 1192 1184 1184
query77 799 259 250 250
query78 31742 54479 47630 47630
query79 14950 639 645 639
query80 4741 379 381 379
query81 556 231 229 229
query82 634 97 102 97
query83 335 140 131 131
query84 257 71 77 71
query85 2490 288 283 283
query86 484 369 381 369
query87 3251 3025 2973 2973
query88 6454 2345 2343 2343
query89 379 288 294 288
query90 2525 222 213 213
query91 156 113 117 113
query92 65 47 49 47
query93 4284 575 574 574
query94 1846 206 214 206
query95 1096 1124 1066 1066
query96 637 344 334 334
query97 6406 6303 6331 6303
query98 188 179 170 170
query99 3920 883 863 863
Total cold run time: 345819 ms
Total hot run time: 238131 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1922739143
<details>
<summary>ClickBench: <b>Total hot run time: 30.95 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0d0025502b5974302d8e72c5c1f62aca3bee2dac, data reload: false
query1 0.02 0.02 0.02
query2 0.05 0.02 0.02
query3 0.24 0.04 0.06
query4 1.84 0.06 0.06
query5 0.54 0.51 0.52
query6 1.27 0.62 0.61
query7 0.01 0.01 0.01
query8 0.03 0.02 0.03
query9 0.52 0.49 0.48
query10 0.54 0.52 0.54
query11 0.12 0.09 0.09
query12 0.11 0.09 0.09
query13 0.62 0.61 0.60
query14 0.79 0.77 0.78
query15 0.78 0.76 0.76
query16 0.37 0.37 0.36
query17 1.01 1.01 1.03
query18 0.24 0.22 0.26
query19 1.89 1.81 1.87
query20 0.02 0.01 0.01
query21 15.49 0.56 0.56
query22 2.26 2.81 1.49
query23 17.34 0.94 0.87
query24 6.11 1.69 1.30
query25 1.63 0.11 0.10
query26 0.32 0.14 0.13
query27 0.11 0.10 0.11
query28 5.99 0.77 0.73
query29 12.71 2.34 2.38
query30 0.56 0.51 0.52
query31 2.83 0.37 0.38
query32 3.42 0.49 0.50
query33 3.04 3.06 3.04
query34 15.33 4.83 4.79
query35 4.85 4.86 4.87
query36 1.05 1.02 1.04
query37 0.06 0.05 0.04
query38 0.04 0.02 0.02
query39 0.02 0.02 0.01
query40 0.15 0.14 0.14
query41 0.07 0.01 0.01
query42 0.02 0.01 0.01
query43 0.02 0.01 0.02
Total cold run time: 104.43 s
Total hot run time: 30.95 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1922741981
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 0d0025502b5974302d8e72c5c1f62aca3bee2dac with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1920619411
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 4a188259a692d425bbefdd8b462c00eacd9d6388 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 21.6 seconds inserted 10000000 Rows, about 462K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pick](nereids)do not check invisible column stats [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30676:
URL: https://github.com/apache/doris/pull/30676#issuecomment-1922724861
<details>
<summary>TPC-H: <b>Total hot run time: 49883 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0d0025502b5974302d8e72c5c1f62aca3bee2dac, data reload: false
------ Round 1 ----------------------------------
q1 17605 4350 4360 4350
q2 2046 147 143 143
q3 10286 1864 1916 1864
q4 10113 1255 1313 1255
q5 8353 3908 3991 3908
q6 220 122 120 120
q7 2045 1604 1624 1604
q8 9314 2738 2721 2721
q9 11339 10755 10630 10630
q10 8741 3492 3466 3466
q11 414 239 239 239
q12 463 298 304 298
q13 18358 3969 4083 3969
q14 347 326 328 326
q15 499 452 460 452
q16 686 589 600 589
q17 1137 940 965 940
q18 7392 6750 6796 6750
q19 1685 1579 1513 1513
q20 521 329 305 305
q21 4414 4041 4123 4041
q22 503 404 400 400
Total cold run time: 116481 ms
Total hot run time: 49883 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4295 4356 4319 4319
q2 313 222 222 222
q3 4144 4165 4131 4131
q4 2770 2742 2741 2741
q5 7350 7213 7207 7207
q6 232 121 119 119
q7 3262 2872 2859 2859
q8 4330 4485 4465 4465
q9 17576 17412 17422 17412
q10 4260 4239 4302 4239
q11 777 668 677 668
q12 1017 877 872 872
q13 6870 3753 3735 3735
q14 447 423 419 419
q15 494 456 455 455
q16 757 725 690 690
q17 3814 3965 3832 3832
q18 8855 8651 8692 8651
q19 1702 1688 1639 1639
q20 2375 2149 2110 2110
q21 8608 8592 8435 8435
q22 1049 938 1006 938
Total cold run time: 85297 ms
Total hot run time: 80158 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org