You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "englefly (via GitHub)" <gi...@apache.org> on 2024/02/21 10:32:22 UTC
[PR] [opt](Nereids)choose better column for count star [doris]
englefly opened a new pull request, #31227:
URL: https://github.com/apache/doris/pull/31227
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958926543
<details>
<summary>TPC-H: <b>Total hot run time: 41073 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 50cb4f02eef7bf3ea7127db383fcc523337a7a36, data reload: false
------ Round 1 ----------------------------------
q1 17633 5024 4923 4923
q2 2036 137 133 133
q3 10600 1640 985 985
q4 4656 976 977 976
q5 7599 3129 3209 3129
q6 200 137 126 126
q7 1243 761 747 747
q8 9246 2062 2045 2045
q9 7472 6583 6582 6582
q10 8338 2635 2649 2635
q11 417 213 223 213
q12 745 333 331 331
q13 17926 3582 3626 3582
q14 318 254 264 254
q15 631 521 497 497
q16 473 423 404 404
q17 921 869 860 860
q18 7723 6821 6606 6606
q19 1566 1484 1494 1484
q20 558 274 269 269
q21 7065 4041 3980 3980
q22 865 338 312 312
Total cold run time: 108231 ms
Total hot run time: 41073 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4868 4868 4903 4868
q2 292 181 185 181
q3 3607 3589 3599 3589
q4 2539 2556 2554 2554
q5 5751 5738 5753 5738
q6 211 126 125 125
q7 2257 1686 1666 1666
q8 3065 3097 3124 3097
q9 8696 8709 8668 8668
q10 6775 4237 4249 4237
q11 519 377 387 377
q12 785 545 543 543
q13 5171 3414 3440 3414
q14 279 251 236 236
q15 592 506 509 506
q16 487 431 461 431
q17 1688 1638 1624 1624
q18 8342 7650 7719 7650
q19 1635 1643 1642 1642
q20 2134 1857 1861 1857
q21 6616 6316 6218 6218
q22 562 508 495 495
Total cold run time: 66871 ms
Total hot run time: 59716 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958891571
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958888975
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958560418
<details>
<summary>TPC-H: <b>Total hot run time: 41307 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0ae0ed1d7e93f36e50fa4cee579102cbf4c275aa, data reload: false
------ Round 1 ----------------------------------
q1 17634 4991 4881 4881
q2 2039 136 131 131
q3 10581 1008 1000 1000
q4 4663 975 1000 975
q5 7644 3183 3219 3183
q6 198 138 133 133
q7 1288 803 760 760
q8 9240 2083 2070 2070
q9 7505 6622 6591 6591
q10 8320 2654 2641 2641
q11 417 202 221 202
q12 724 327 338 327
q13 17917 3611 3615 3611
q14 298 260 255 255
q15 642 528 496 496
q16 483 435 411 411
q17 941 904 895 895
q18 7578 6745 6692 6692
q19 1568 1503 1497 1497
q20 558 282 265 265
q21 6850 3961 3971 3961
q22 877 341 330 330
Total cold run time: 107965 ms
Total hot run time: 41307 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4818 4828 4824 4824
q2 294 187 182 182
q3 3621 3584 3597 3584
q4 2551 2565 2545 2545
q5 5819 5754 5750 5750
q6 207 132 133 132
q7 2254 1646 1681 1646
q8 3021 3126 3119 3119
q9 8740 8787 8719 8719
q10 6790 4229 4241 4229
q11 531 366 372 366
q12 783 553 554 553
q13 6142 3400 3434 3400
q14 262 243 241 241
q15 596 497 500 497
q16 513 429 445 429
q17 1640 1626 1633 1626
q18 8402 7627 7668 7627
q19 1646 1650 1647 1647
q20 2110 1869 1826 1826
q21 6708 6281 6240 6240
q22 590 513 508 508
Total cold run time: 68038 ms
Total hot run time: 59690 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958942670
<details>
<summary>TPC-DS: <b>Total hot run time: 176334 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 50cb4f02eef7bf3ea7127db383fcc523337a7a36, data reload: false
query1 925 351 351 351
query2 6496 1736 1791 1736
query3 6701 210 199 199
query4 23287 21173 21111 21111
query5 4293 370 367 367
query6 257 167 171 167
query7 4619 285 287 285
query8 245 190 196 190
query9 8469 2770 2765 2765
query10 424 230 223 223
query11 15017 14657 14599 14599
query12 130 80 87 80
query13 1676 420 421 420
query14 9043 7668 7665 7665
query15 211 188 184 184
query16 7192 255 245 245
query17 1427 556 523 523
query18 2063 266 264 264
query19 192 150 146 146
query20 87 80 82 80
query21 189 123 113 113
query22 4927 4784 4767 4767
query23 32339 31464 31440 31440
query24 12706 3392 3441 3392
query25 639 384 357 357
query26 1879 149 162 149
query27 3055 309 312 309
query28 6618 1851 1856 1851
query29 1242 612 605 605
query30 278 134 145 134
query31 950 748 734 734
query32 100 59 55 55
query33 718 233 231 231
query34 1068 479 491 479
query35 941 848 822 822
query36 1001 928 897 897
query37 178 64 59 59
query38 3310 3168 3183 3168
query39 1375 1317 1317 1317
query40 282 104 102 102
query41 37 37 34 34
query42 106 96 98 96
query43 478 442 442 442
query44 1053 676 692 676
query45 194 182 173 173
query46 1041 754 755 754
query47 1628 1555 1537 1537
query48 410 353 342 342
query49 1242 304 300 300
query50 767 361 363 361
query51 4448 4319 4372 4319
query52 109 94 91 91
query53 405 297 298 297
query54 301 218 223 218
query55 83 83 84 83
query56 217 204 210 204
query57 1058 972 920 920
query58 223 189 192 189
query59 2269 2102 2207 2102
query60 240 218 223 218
query61 82 83 87 83
query62 611 381 382 381
query63 318 282 291 282
query64 6343 3021 3081 3021
query65 3284 3238 3258 3238
query66 1373 324 323 323
query67 14813 14127 14176 14127
query68 5099 552 550 550
query69 514 341 340 340
query70 1239 1245 1220 1220
query71 425 255 252 252
query72 6269 2774 2614 2614
query73 690 308 308 308
query74 6927 6398 6409 6398
query75 3218 2534 2550 2534
query76 3327 1096 1179 1096
query77 381 237 236 236
query78 9477 8841 8735 8735
query79 972 544 520 520
query80 505 347 332 332
query81 439 208 208 208
query82 234 86 84 84
query83 141 126 125 125
query84 229 76 75 75
query85 1031 336 327 327
query86 305 306 298 298
query87 3494 3294 3272 3272
query88 2724 2286 2275 2275
query89 452 366 350 350
query90 1964 165 160 160
query91 159 126 123 123
query92 54 48 49 48
query93 1007 507 498 498
query94 1110 173 176 173
query95 440 329 341 329
query96 573 263 261 261
query97 4463 4286 4298 4286
query98 208 205 191 191
query99 1120 760 724 724
Total cold run time: 268872 ms
Total hot run time: 176334 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 commented on code in PR #31227:
URL: https://github.com/apache/doris/pull/31227#discussion_r1498779247
##########
fe/fe-core/src/test/java/org/apache/doris/nereids/jobs/joinorder/TPCHTest.java:
##########
@@ -33,4 +38,34 @@ void testQ5() {
.dpHypOptimize()
.printlnBestPlanTree();
}
+
+
+ // count(*) projects on children key columns
+ @Test
+ void testCountStarProject() {
+ String sql = "select\n"
+ + " count(*) as order_count\n"
+ + "from\n"
+ + " orders\n"
+ + "where\n"
+ + " o_orderdate >= date '1993-07-01'\n"
+ + " and o_orderdate < date '1993-07-01' + interval '3' month\n"
+ + " and exists (\n"
+ + " select\n"
+ + " *\n"
+ + " from\n"
+ + " lineitem\n"
+ + " where\n"
+ + " l_orderkey = o_orderkey\n"
+ + " and l_commitdate < l_receiptdate\n"
+ + " );";
+
+ PlanChecker checker = PlanChecker.from(connectContext)
+ .analyze(sql)
+ .rewrite();
+ List<? extends Expression> proj = checker.getPlan().child(0).child(0).getExpressions();
+ Assertions.assertEquals(proj.size(), 1);
+ Assertions.assertTrue(proj.get(0) instanceof SlotReference
+ && "o_orderdate".equals(proj.get(0).toSql()));
Review Comment:
please check the shape of top plan, is it `logicalAggregate(logicalProject())`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958956455
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 50cb4f02eef7bf3ea7127db383fcc523337a7a36 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.6 seconds inserted 10000000 Rows, about 735K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958889945
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #31227:
URL: https://github.com/apache/doris/pull/31227
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "924060929 (via GitHub)" <gi...@apache.org>.
924060929 commented on code in PR #31227:
URL: https://github.com/apache/doris/pull/31227#discussion_r1498779247
##########
fe/fe-core/src/test/java/org/apache/doris/nereids/jobs/joinorder/TPCHTest.java:
##########
@@ -33,4 +38,34 @@ void testQ5() {
.dpHypOptimize()
.printlnBestPlanTree();
}
+
+
+ // count(*) projects on children key columns
+ @Test
+ void testCountStarProject() {
+ String sql = "select\n"
+ + " count(*) as order_count\n"
+ + "from\n"
+ + " orders\n"
+ + "where\n"
+ + " o_orderdate >= date '1993-07-01'\n"
+ + " and o_orderdate < date '1993-07-01' + interval '3' month\n"
+ + " and exists (\n"
+ + " select\n"
+ + " *\n"
+ + " from\n"
+ + " lineitem\n"
+ + " where\n"
+ + " l_orderkey = o_orderkey\n"
+ + " and l_commitdate < l_receiptdate\n"
+ + " );";
+
+ PlanChecker checker = PlanChecker.from(connectContext)
+ .analyze(sql)
+ .rewrite();
+ List<? extends Expression> proj = checker.getPlan().child(0).child(0).getExpressions();
+ Assertions.assertEquals(proj.size(), 1);
+ Assertions.assertTrue(proj.get(0) instanceof SlotReference
+ && "o_orderdate".equals(proj.get(0).toSql()));
Review Comment:
please check the shape of top plan, is it `logicalResultSink(logicalAggregate(logicalProject()))`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958568446
<details>
<summary>TPC-DS: <b>Total hot run time: 177592 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0ae0ed1d7e93f36e50fa4cee579102cbf4c275aa, data reload: false
query1 925 355 351 351
query2 6545 1767 1823 1767
query3 6704 202 198 198
query4 23318 21178 21181 21178
query5 4263 391 403 391
query6 265 186 177 177
query7 4614 301 299 299
query8 244 214 200 200
query9 8426 2867 2868 2867
query10 417 218 227 218
query11 15041 14710 14410 14410
query12 134 89 85 85
query13 1703 425 423 423
query14 9292 7723 7695 7695
query15 216 199 196 196
query16 7399 259 249 249
query17 1416 574 544 544
query18 1950 269 264 264
query19 202 151 149 149
query20 91 85 87 85
query21 189 124 131 124
query22 4891 4712 4778 4712
query23 32483 31425 31532 31425
query24 12822 3556 3598 3556
query25 643 366 382 366
query26 1868 158 160 158
query27 3043 316 324 316
query28 6636 1850 1832 1832
query29 1188 666 655 655
query30 283 145 153 145
query31 935 741 768 741
query32 94 63 57 57
query33 721 225 232 225
query34 1086 497 510 497
query35 984 854 851 851
query36 982 883 880 880
query37 138 62 63 62
query38 3293 3148 3234 3148
query39 1355 1346 1338 1338
query40 289 115 108 108
query41 38 38 35 35
query42 106 100 101 100
query43 476 436 454 436
query44 1079 691 704 691
query45 206 184 178 178
query46 1120 794 789 789
query47 1658 1584 1549 1549
query48 417 348 351 348
query49 1201 318 314 314
query50 839 387 374 374
query51 4442 4297 4338 4297
query52 109 97 91 91
query53 435 336 324 324
query54 288 236 245 236
query55 88 80 86 80
query56 224 214 199 199
query57 1044 916 956 916
query58 222 198 202 198
query59 2198 2067 2012 2012
query60 250 218 229 218
query61 89 81 79 79
query62 598 380 363 363
query63 364 316 308 308
query64 6481 3237 3346 3237
query65 3325 3314 3270 3270
query66 1384 328 326 326
query67 14539 14406 14266 14266
query68 5189 547 558 547
query69 516 366 375 366
query70 1230 1293 1257 1257
query71 444 256 254 254
query72 6373 2823 2591 2591
query73 747 319 318 318
query74 6827 6478 6432 6432
query75 3315 2632 2619 2619
query76 3274 1239 1306 1239
query77 368 248 247 247
query78 9402 8865 8862 8862
query79 1036 516 526 516
query80 549 378 354 354
query81 444 207 209 207
query82 168 89 87 87
query83 148 126 122 122
query84 227 78 76 76
query85 1056 357 347 347
query86 297 307 312 307
query87 3448 3291 3274 3274
query88 2714 2285 2286 2285
query89 445 367 355 355
query90 1970 162 170 162
query91 157 127 128 127
query92 59 52 50 50
query93 1051 519 497 497
query94 1122 177 177 177
query95 439 348 350 348
query96 624 263 263 263
query97 4489 4292 4238 4238
query98 223 211 195 195
query99 1042 720 697 697
Total cold run time: 269701 ms
Total hot run time: 177592 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958572305
<details>
<summary>ClickBench: <b>Total hot run time: 31.26 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0ae0ed1d7e93f36e50fa4cee579102cbf4c275aa, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.03 0.03
query3 0.23 0.07 0.08
query4 1.65 0.08 0.08
query5 0.50 0.49 0.49
query6 1.37 0.62 0.62
query7 0.02 0.02 0.01
query8 0.04 0.02 0.02
query9 0.53 0.47 0.44
query10 0.49 0.48 0.51
query11 0.12 0.10 0.09
query12 0.12 0.10 0.11
query13 0.59 0.58 0.58
query14 0.76 0.79 0.81
query15 0.83 0.80 0.79
query16 0.33 0.32 0.33
query17 0.89 0.89 0.93
query18 0.20 0.14 0.18
query19 1.76 1.70 1.70
query20 0.01 0.00 0.01
query21 15.41 0.67 0.59
query22 2.79 4.54 2.50
query23 17.68 1.08 1.04
query24 2.21 0.63 0.30
query25 0.63 0.07 0.06
query26 0.18 0.12 0.14
query27 0.06 0.05 0.05
query28 11.81 0.86 0.84
query29 12.75 3.44 3.48
query30 0.55 0.49 0.50
query31 2.79 0.35 0.36
query32 3.36 0.48 0.48
query33 3.15 3.17 3.15
query34 15.36 4.49 4.49
query35 4.50 4.48 4.50
query36 1.10 0.96 0.95
query37 0.06 0.05 0.04
query38 0.04 0.03 0.03
query39 0.02 0.01 0.01
query40 0.18 0.15 0.14
query41 0.07 0.02 0.01
query42 0.03 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.28 s
Total hot run time: 31.26 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "englefly (via GitHub)" <gi...@apache.org>.
englefly commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958524899
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958951734
<details>
<summary>ClickBench: <b>Total hot run time: 30.65 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 50cb4f02eef7bf3ea7127db383fcc523337a7a36, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.03
query3 0.23 0.07 0.07
query4 1.62 0.07 0.08
query5 0.50 0.48 0.49
query6 1.36 0.61 0.62
query7 0.02 0.02 0.01
query8 0.03 0.02 0.02
query9 0.52 0.45 0.43
query10 0.50 0.48 0.47
query11 0.12 0.09 0.10
query12 0.12 0.10 0.10
query13 0.59 0.58 0.58
query14 0.76 0.80 0.78
query15 0.82 0.82 0.80
query16 0.36 0.33 0.33
query17 0.90 0.90 0.89
query18 0.17 0.16 0.17
query19 1.73 1.72 1.70
query20 0.02 0.01 0.01
query21 15.40 0.67 0.60
query22 3.13 3.40 2.04
query23 17.44 1.04 1.04
query24 2.17 0.40 0.39
query25 0.59 0.07 0.06
query26 0.16 0.14 0.13
query27 0.06 0.05 0.05
query28 11.96 0.84 0.84
query29 12.63 3.38 3.27
query30 0.51 0.48 0.47
query31 2.78 0.35 0.37
query32 3.32 0.47 0.47
query33 3.10 3.11 3.14
query34 15.35 4.48 4.47
query35 4.48 4.48 4.48
query36 1.08 0.94 0.94
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.17 0.15 0.16
query41 0.07 0.02 0.01
query42 0.03 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.04 s
Total hot run time: 30.65 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958574646
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 0ae0ed1d7e93f36e50fa4cee579102cbf4c275aa with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.3 seconds inserted 10000000 Rows, about 751K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1956350865
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](Nereids)choose better column for count star [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31227:
URL: https://github.com/apache/doris/pull/31227#issuecomment-1958888922
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org