You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Jibing-Li (via GitHub)" <gi...@apache.org> on 2023/12/28 12:12:47 UTC
[PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Jibing-Li opened a new pull request, #29254:
URL: https://github.com/apache/doris/pull/29254
Create or update table stats after alter column stats.
Set flag to disable auto analyze for the table after user inject column stats.
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "morrySnow (via GitHub)" <gi...@apache.org>.
morrySnow merged PR #29254:
URL: https://github.com/apache/doris/pull/29254
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882467386
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882499735
<details>
<summary>TPC-H: <b>Total hot run time: 38809 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 261c3295caba9cf0ee48f4930337603251c63c0b, data reload: false
------ Round 1 ----------------------------------
q1 17668 4974 4940 4940
q2 2031 154 145 145
q3 10756 1182 1155 1155
q4 10429 789 848 789
q5 7813 2998 3005 2998
q6 226 130 127 127
q7 920 513 500 500
q8 9231 1994 2027 1994
q9 6482 6456 6400 6400
q10 8291 3043 3027 3027
q11 454 211 209 209
q12 401 235 234 234
q13 18012 3438 3386 3386
q14 244 212 209 209
q15 559 508 501 501
q16 497 402 395 395
q17 961 701 610 610
q18 7379 6743 6690 6690
q19 1574 1539 1528 1528
q20 712 334 316 316
q21 2738 2350 2397 2350
q22 391 306 314 306
Total cold run time: 107769 ms
Total hot run time: 38809 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4901 4940 4928 4928
q2 342 238 249 238
q3 3299 3317 3315 3315
q4 2131 2016 2005 2005
q5 5839 5780 5827 5780
q6 203 115 117 115
q7 2372 1935 1906 1906
q8 3394 3481 3525 3481
q9 8819 8786 8813 8786
q10 3848 3878 3890 3878
q11 549 454 456 454
q12 809 631 643 631
q13 4029 3171 3202 3171
q14 307 263 289 263
q15 554 507 502 502
q16 570 514 486 486
q17 1848 1923 1872 1872
q18 8592 8447 8340 8340
q19 1603 1636 1624 1624
q20 2229 1997 1967 1967
q21 5525 5303 5333 5303
q22 519 467 463 463
Total cold run time: 62282 ms
Total hot run time: 59508 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871823785
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 4db24fae866dbbfa1105647aaf9f89f7045b6277, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5491 5149 5174 5149
q2 389 178 158 158
q3 1449 1118 1269 1118
q4 1097 860 805 805
q5 3165 3084 3124 3084
q6 232 138 142 138
q7 995 559 527 527
q8 2139 2134 2147 2134
q9 6723 6667 6646 6646
q10 3190 3212 3170 3170
q11 345 233 235 233
q12 392 244 240 240
q13 4392 3624 3635 3624
q14 262 229 219 219
q15 635 579 566 566
q16 463 396 393 393
q17 1043 686 531 531
q18 7131 6759 6831 6759
q19 1635 1559 1616 1559
q20 573 388 371 371
q21 2900 2470 2434 2434
q22 408 333 341 333
Total cold run time: 45049 ms
Total hot run time: 40191 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5044 5101 5060 5060
q2 334 259 250 250
q3 3376 3345 3328 3328
q4 2140 2016 1999 1999
q5 5935 5914 5923 5914
q6 238 132 133 132
q7 2399 1982 1955 1955
q8 3569 3649 3649 3649
q9 9123 9027 8988 8988
q10 3885 3930 3946 3930
q11 601 491 487 487
q12 801 655 645 645
q13 3877 3208 3188 3188
q14 307 279 272 272
q15 648 564 569 564
q16 556 532 529 529
q17 2046 1807 1808 1807
q18 8830 8301 8367 8301
q19 1750 1752 1707 1707
q20 2292 2013 1994 1994
q21 5712 5300 5340 5300
q22 559 544 523 523
Total cold run time: 64022 ms
Total hot run time: 60522 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871232567
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882484366
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882511062
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.55 seconds
stream load tsv: 567 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 27.4 seconds inserted 10000000 Rows, about 364K ops/s
storage size: 17183774023 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871283280
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 08f961d1d8a98126df9a966ebc0ba4aed35450aa, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5511 5157 5077 5077
q2 392 181 170 170
q3 1471 1217 1278 1217
q4 1108 900 822 822
q5 3146 3074 3070 3070
q6 232 142 139 139
q7 992 566 532 532
q8 2185 2233 2211 2211
q9 6860 6851 6835 6835
q10 3207 3137 3127 3127
q11 357 225 230 225
q12 394 248 237 237
q13 4410 3640 3636 3636
q14 252 214 232 214
q15 615 562 558 558
q16 463 405 429 405
q17 1054 538 539 538
q18 7116 6799 6737 6737
q19 1649 1571 1500 1500
q20 598 340 351 340
q21 2934 2508 2547 2508
q22 392 340 343 340
Total cold run time: 45338 ms
Total hot run time: 40438 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 5092 5127 5037 5037
q2 340 265 255 255
q3 3369 3333 3308 3308
q4 2157 1968 2015 1968
q5 5947 5949 5961 5949
q6 239 131 136 131
q7 2418 1937 1937 1937
q8 3537 3640 3650 3640
q9 9135 9019 9046 9019
q10 3894 3949 3936 3936
q11 577 501 492 492
q12 806 630 656 630
q13 3878 3172 3203 3172
q14 295 283 280 280
q15 629 550 575 550
q16 551 523 537 523
q17 2042 1817 1799 1799
q18 8708 8380 8341 8341
q19 1770 1709 1740 1709
q20 2400 2004 1984 1984
q21 5729 5391 5268 5268
q22 585 531 478 478
Total cold run time: 64098 ms
Total hot run time: 60406 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871110312
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871272409
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.56 seconds
stream load tsv: 579 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17188510670 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871819685
TPC-DS test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpcds-tools
```
TPC-DS sf100 test result on commit 4db24fae866dbbfa1105647aaf9f89f7045b6277, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 931 355 337 337
query2 6409 1962 1994 1962
query3 6661 220 212 212
query4 26968 22485 22379 22379
query5 5038 582 558 558
query6 285 181 176 176
query7 4576 289 278 278
query8 222 204 194 194
query9 8067 2769 2719 2719
query10 461 278 240 240
query11 16205 15551 15477 15477
query12 136 79 80 79
query13 1634 335 332 332
query14 11787 7302 7211 7211
query15 248 188 194 188
query16 6475 296 285 285
query17 1769 509 499 499
query18 1930 264 261 261
query19 278 145 146 145
query20 82 78 80 78
query21 186 98 99 98
query22 4990 4728 4450 4450
query23 32076 31258 31364 31258
query24 12002 2844 2778 2778
query25 602 351 348 348
query26 1694 144 147 144
query27 2867 282 293 282
query28 7035 2000 1997 1997
query29 2061 398 398 398
query30 286 145 147 145
query31 947 783 781 781
query32 91 60 59 59
query33 717 282 281 281
query34 821 462 453 453
query35 881 802 791 791
query36 1274 1291 1276 1276
query37 201 87 87 87
query38 3418 3252 3251 3251
query39 1317 1283 1277 1277
query40 303 96 90 90
query41 38 36 34 34
query42 98 90 95 90
query43 522 486 493 486
query44 1091 753 766 753
query45 198 188 181 181
query46 1099 649 679 649
query47 1724 1607 1573 1573
query48 350 277 275 275
query49 1199 330 328 328
query50 735 363 341 341
query51 5490 5222 5261 5222
query52 102 88 91 88
query53 215 152 154 152
query54 1478 639 634 634
query55 100 90 91 90
query56 221 205 208 205
query57 1002 958 926 926
query58 232 207 207 207
query59 2721 2577 2502 2502
query60 263 230 241 230
query61 87 89 84 84
query62 670 477 460 460
query63 169 160 153 153
query64 5932 1836 1725 1725
query65 3336 3239 3240 3239
query66 1321 339 322 322
query67 15557 15286 15337 15286
query68 13646 550 534 534
query69 645 268 262 262
query70 1786 1591 1434 1434
query71 563 237 232 232
query72 5602 3678 3614 3614
query73 2120 336 322 322
query74 7047 6497 6472 6472
query75 6023 2261 2247 2247
query76 6195 1112 1113 1112
query77 911 298 292 292
query78 9054 8580 8522 8522
query79 3826 513 515 513
query80 1101 385 391 385
query81 513 212 204 204
query82 242 126 123 123
query83 408 148 144 144
query84 259 59 56 56
query85 989 294 299 294
query86 403 414 390 390
query87 3547 3360 3370 3360
query88 3248 2388 2401 2388
query89 324 268 256 256
query90 1902 248 246 246
query91 122 104 94 94
query92 72 59 55 55
query93 2709 515 450 450
query94 876 216 217 216
query95 503 471 459 459
query96 649 331 330 330
query97 4318 4124 4180 4124
query98 217 194 188 188
query99 1117 869 817 817
Total cold run time: 300818 ms
Total hot run time: 180224 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882467418
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871798303
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882427992
run buidall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1882510660
<details>
<summary>TPC-DS: <b>Total hot run time: 183941 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 261c3295caba9cf0ee48f4930337603251c63c0b, data reload: false
run tpcds-sf100 query with default conf and session variables
query1 889 345 337 337
query2 5543 2014 1833 1833
query3 6079 235 218 218
query4 27547 22610 22531 22531
query5 5531 609 591 591
query6 346 210 202 202
query7 4530 312 312 312
query8 267 226 222 222
query9 8560 2923 2911 2911
query10 571 344 351 344
query11 16091 15697 15801 15697
query12 162 126 96 96
query13 1690 334 341 334
query14 12174 7659 7685 7659
query15 251 238 238 238
query16 6127 336 324 324
query17 1653 523 534 523
query18 1914 302 297 297
query19 225 166 165 165
query20 110 101 105 101
query21 180 99 91 91
query22 5042 4777 4768 4768
query23 32231 31061 31426 31061
query24 12068 2951 2947 2947
query25 577 365 367 365
query26 1663 173 175 173
query27 2870 308 311 308
query28 6464 2110 2112 2110
query29 1844 408 416 408
query30 277 146 148 146
query31 1032 831 811 811
query32 126 88 74 74
query33 801 342 347 342
query34 867 480 493 480
query35 974 911 933 911
query36 1331 1233 1276 1233
query37 187 90 94 90
query38 3556 3346 3420 3346
query39 1346 1302 1319 1302
query40 288 90 85 85
query41 38 37 36 36
query42 110 115 103 103
query43 543 537 526 526
query44 1208 800 819 800
query45 215 212 215 212
query46 1106 704 719 704
query47 1727 1598 1588 1588
query48 383 295 280 280
query49 1085 326 324 324
query50 735 363 333 333
query51 5513 5269 5395 5269
query52 103 100 93 93
query53 229 168 168 168
query54 1134 666 639 639
query55 106 102 97 97
query56 259 250 258 250
query57 1028 1001 990 990
query58 302 256 270 256
query59 2965 2769 2904 2769
query60 326 287 290 287
query61 135 150 150 150
query62 579 502 491 491
query63 194 188 169 169
query64 5527 1829 1764 1764
query65 3449 3375 3345 3345
query66 1273 401 370 370
query67 15575 15267 15575 15267
query68 13303 537 569 537
query69 602 303 311 303
query70 1765 1635 1605 1605
query71 596 274 256 256
query72 5495 3453 3478 3453
query73 3052 345 350 345
query74 7003 6663 6572 6572
query75 5873 2302 2261 2261
query76 6815 1047 1242 1047
query77 1050 343 324 324
query78 9155 8537 8504 8504
query79 1093 554 517 517
query80 637 348 343 343
query81 482 215 218 215
query82 226 106 103 103
query83 227 142 143 142
query84 251 59 59 59
query85 879 278 270 270
query86 434 444 424 424
query87 3629 3501 3454 3454
query88 3244 2514 2446 2446
query89 357 285 287 285
query90 2212 262 252 252
query91 126 94 96 94
query92 98 76 72 72
query93 1205 424 486 424
query94 1032 245 252 245
query95 594 508 508 508
query96 636 328 344 328
query97 4406 4232 4235 4232
query98 244 219 226 219
query99 1153 876 836 836
Total cold run time: 297705 ms
Total hot run time: 183941 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871155062
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.55 seconds
stream load tsv: 567 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size: 17184131486 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871188257
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 8fb7c5b44e3fa3cf865025fcd8fb3d01d08bb343, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4977 4658 4691 4658
q2 371 164 160 160
q3 1457 1314 1231 1231
q4 1133 963 919 919
q5 3202 3179 3163 3163
q6 258 129 129 129
q7 1038 488 497 488
q8 2269 2260 2260 2260
q9 6725 6717 6717 6717
q10 3204 3270 3262 3262
q11 338 222 207 207
q12 353 219 207 207
q13 4139 3412 3365 3365
q14 244 214 213 213
q15 569 524 526 524
q16 443 389 381 381
q17 1054 813 588 588
q18 7112 6833 6782 6782
q19 1630 1637 1651 1637
q20 511 293 309 293
q21 3191 2727 2706 2706
q22 371 301 308 301
Total cold run time: 44589 ms
Total hot run time: 40191 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4601 4624 4579 4579
q2 270 164 170 164
q3 3375 3371 3358 3358
q4 2229 2206 2208 2206
q5 5723 5724 5715 5715
q6 239 121 123 121
q7 2379 1889 1860 1860
q8 3610 3621 3610 3610
q9 8959 8983 8964 8964
q10 3811 3908 3890 3890
q11 484 363 369 363
q12 772 599 596 596
q13 3888 3199 3151 3151
q14 292 254 263 254
q15 570 523 523 523
q16 497 454 467 454
q17 1990 1949 1941 1941
q18 8604 8217 8117 8117
q19 1763 1755 1751 1751
q20 2241 1939 1902 1902
q21 6122 5751 5744 5744
q22 564 467 469 467
Total cold run time: 62983 ms
Total hot run time: 59730 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871820857
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.75 seconds
stream load tsv: 578 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17184171859 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Create or update table stats after alter column stats. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29254:
URL: https://github.com/apache/doris/pull/29254#issuecomment-1871814769
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G', run with scripts in https://github.com/apache/doris/tree/master/tools/tpch-tools
```
Tpch sf100 test result on commit 4db24fae866dbbfa1105647aaf9f89f7045b6277, data reload: false
------ Round 1 ----------------------------------
q1 17640 5164 5032 5032
q2 2009 160 146 146
q3 10528 1079 1145 1079
q4 10202 854 847 847
q5 7794 2982 2961 2961
q6 213 139 138 138
q7 940 553 512 512
q8 9287 2031 2038 2031
q9 6885 6417 6379 6379
q10 8260 3011 3031 3011
q11 438 235 218 218
q12 384 238 244 238
q13 17987 3621 3613 3613
q14 239 216 204 204
q15 604 553 567 553
q16 441 423 396 396
q17 973 456 459 456
q18 7272 6644 6683 6644
q19 1585 1326 1395 1326
q20 752 342 329 329
q21 2842 2365 2479 2365
q22 374 327 345 327
Total cold run time: 107649 ms
Total hot run time: 38805 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5135 5074 5021 5021
q2 340 257 256 256
q3 3329 3243 3241 3241
q4 2124 1977 1972 1972
q5 5778 5799 5816 5799
q6 220 129 131 129
q7 2327 1858 1893 1858
q8 3372 3451 3459 3451
q9 8819 8809 8787 8787
q10 3775 3834 3835 3834
q11 605 515 489 489
q12 790 659 650 650
q13 9687 3330 3366 3330
q14 290 290 284 284
q15 626 550 548 548
q16 565 539 519 519
q17 1984 1806 1752 1752
q18 8685 8338 8276 8276
q19 1634 1580 1583 1580
q20 2192 1986 1953 1953
q21 5614 5468 5352 5352
q22 552 488 510 488
Total cold run time: 68443 ms
Total hot run time: 59569 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org