You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Jibing-Li (via GitHub)" <gi...@apache.org> on 2024/01/16 06:41:55 UTC
[PR] [unit test](statistics)Add unit test case for auto analyze. #29904 [doris]
Jibing-Li opened a new pull request, #30017:
URL: https://github.com/apache/doris/pull/30017
Add unit and p0 test case for auto analyze.
backport https://github.com/apache/doris/pull/29904
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [unit test](statistics)Add unit test case for auto analyze. #29904 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30017:
URL: https://github.com/apache/doris/pull/30017#issuecomment-1893200131
<details>
<summary>ClickBench: <b>Total hot run time: 30.98 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 90f6248a426bdb39e95958fe8696b32fa2069e03, data reload: false
query1 0.02 0.02 0.02
query2 0.06 0.02 0.03
query3 0.25 0.04 0.05
query4 1.83 0.06 0.07
query5 0.53 0.53 0.53
query6 1.23 0.61 0.61
query7 0.01 0.01 0.01
query8 0.04 0.02 0.03
query9 0.53 0.49 0.47
query10 0.54 0.53 0.53
query11 0.11 0.08 0.09
query12 0.11 0.10 0.09
query13 0.62 0.61 0.61
query14 0.78 0.80 0.78
query15 0.79 0.76 0.77
query16 0.38 0.37 0.37
query17 1.02 1.00 1.03
query18 0.21 0.28 0.24
query19 1.92 1.88 1.83
query20 0.01 0.01 0.01
query21 15.46 0.56 0.56
query22 2.08 2.16 1.50
query23 17.54 0.95 0.95
query24 6.11 1.23 1.14
query25 2.25 0.16 0.15
query26 0.14 0.13 0.15
query27 0.17 0.16 0.14
query28 6.36 0.76 0.72
query29 12.64 2.31 2.34
query30 0.60 0.51 0.48
query31 2.82 0.39 0.37
query32 3.42 0.50 0.49
query33 3.09 3.09 3.10
query34 15.27 4.77 4.82
query35 4.88 4.87 4.86
query36 1.04 1.01 1.00
query37 0.05 0.05 0.04
query38 0.04 0.02 0.01
query39 0.02 0.01 0.02
query40 0.16 0.14 0.15
query41 0.07 0.02 0.02
query42 0.02 0.01 0.01
query43 0.02 0.02 0.01
Total cold run time: 105.24 s
Total hot run time: 30.98 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [unit test](statistics)Add unit test case for auto analyze. #29904 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30017:
URL: https://github.com/apache/doris/pull/30017#issuecomment-1893203449
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 90f6248a426bdb39e95958fe8696b32fa2069e03 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [unit test](statistics)Add unit test case for auto analyze. #29904 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30017:
URL: https://github.com/apache/doris/pull/30017#issuecomment-1893194301
<details>
<summary>TPC-DS: <b>Total hot run time: 239872 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 90f6248a426bdb39e95958fe8696b32fa2069e03, data reload: false
query1 928 398 381 381
query2 6522 2141 2290 2141
query3 6917 200 205 200
query4 20337 17772 17835 17772
query5 19739 6215 6229 6215
query6 288 212 228 212
query7 4148 299 301 299
query8 281 226 235 226
query9 3151 2732 2635 2635
query10 411 278 295 278
query11 11319 10770 10735 10735
query12 127 80 71 71
query13 5633 641 617 617
query14 17261 13322 13301 13301
query15 379 234 235 234
query16 6449 269 266 266
query17 3184 885 872 872
query18 2266 405 411 405
query19 205 146 152 146
query20 67 79 80 79
query21 185 88 96 88
query22 5396 5091 5101 5091
query23 32446 31822 31925 31822
query24 7101 6446 6571 6446
query25 519 437 428 428
query26 526 159 156 156
query27 1888 300 302 300
query28 6171 2243 2222 2222
query29 2892 2838 2643 2643
query30 239 159 161 159
query31 885 716 744 716
query32 65 55 60 55
query33 401 241 257 241
query34 842 466 489 466
query35 1111 911 941 911
query36 1740 1487 1408 1408
query37 88 58 58 58
query38 3146 2901 2911 2901
query39 1364 1310 1315 1310
query40 205 93 106 93
query41 37 33 31 31
query42 78 78 83 78
query43 669 566 562 562
query44 1128 715 710 710
query45 239 228 230 228
query46 1259 976 958 958
query47 1869 1651 1654 1651
query48 970 696 663 663
query49 622 368 362 362
query50 877 652 602 602
query51 5611 5499 5555 5499
query52 92 83 90 83
query53 435 319 325 319
query54 2426 2228 2253 2228
query55 77 78 72 72
query56 228 209 209 209
query57 1340 1284 1068 1068
query58 224 199 202 199
query59 3382 3226 3233 3226
query60 206 200 206 200
query61 88 86 89 86
query62 840 444 521 444
query63 480 340 335 335
query64 2057 1290 1314 1290
query65 3649 3603 3634 3603
query66 793 363 364 363
query67 15473 15261 16761 15261
query68 9430 669 655 655
query69 553 325 357 325
query70 2113 1852 1806 1806
query71 409 293 314 293
query72 4419 3389 3356 3356
query73 726 320 312 312
query74 6301 5829 5853 5829
query75 4821 3484 3525 3484
query76 6122 1234 1206 1206
query77 964 258 247 247
query78 32291 52069 49805 49805
query79 15739 643 637 637
query80 5117 392 378 378
query81 561 226 233 226
query82 1164 100 90 90
query83 324 135 129 129
query84 262 66 68 66
query85 2492 293 277 277
query86 483 378 368 368
query87 3295 3007 3026 3007
query88 7006 2330 2289 2289
query89 454 281 267 267
query90 2502 212 207 207
query91 158 120 117 117
query92 62 49 51 49
query93 6189 540 570 540
query94 1855 205 206 205
query95 1103 1068 1079 1068
query96 640 317 325 317
query97 6316 6441 6339 6339
query98 182 181 163 163
query99 3860 918 886 886
Total cold run time: 349884 ms
Total hot run time: 239872 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [unit test](statistics)Add unit test case for auto analyze. #29904 [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #30017:
URL: https://github.com/apache/doris/pull/30017
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [unit test](statistics)Add unit test case for auto analyze. #29904 [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #30017:
URL: https://github.com/apache/doris/pull/30017#issuecomment-1893154125
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [unit test](statistics)Add unit test case for auto analyze. #29904 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30017:
URL: https://github.com/apache/doris/pull/30017#issuecomment-1893179434
<details>
<summary>TPC-H: <b>Total hot run time: 49473 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 90f6248a426bdb39e95958fe8696b32fa2069e03, data reload: false
------ Round 1 ----------------------------------
q1 18117 4418 4335 4335
q2 2028 150 141 141
q3 10442 1886 1922 1886
q4 10348 1222 1301 1222
q5 8478 3899 3915 3899
q6 230 125 123 123
q7 2052 1596 1623 1596
q8 9289 2701 2716 2701
q9 10633 10615 10233 10233
q10 8690 3557 3468 3468
q11 425 238 250 238
q12 457 308 303 303
q13 18327 3964 4030 3964
q14 345 326 321 321
q15 504 452 453 452
q16 722 587 591 587
q17 1124 957 975 957
q18 7351 6896 6818 6818
q19 1655 1541 1482 1482
q20 506 317 315 315
q21 4428 4036 4117 4036
q22 500 396 411 396
Total cold run time: 116651 ms
Total hot run time: 49473 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4339 4336 4328 4328
q2 323 223 221 221
q3 4166 4143 4114 4114
q4 2755 2724 2731 2724
q5 7204 7188 7227 7188
q6 232 120 120 120
q7 3239 2929 2793 2793
q8 4385 4468 4484 4468
q9 17009 16926 16881 16881
q10 4210 4279 4266 4266
q11 766 689 702 689
q12 1020 841 854 841
q13 6934 3729 3709 3709
q14 447 425 422 422
q15 498 458 462 458
q16 741 710 699 699
q17 3965 3856 3866 3856
q18 8796 8725 8795 8725
q19 1691 1690 1656 1656
q20 2360 2187 2082 2082
q21 8494 8531 8486 8486
q22 1041 951 930 930
Total cold run time: 84615 ms
Total hot run time: 79656 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org