You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "airborne12 (via GitHub)" <gi...@apache.org> on 2024/03/12 12:57:16 UTC
[PR] [Fix](cloud) fix build index for cloud mode [doris]
airborne12 opened a new pull request, #32143:
URL: https://github.com/apache/doris/pull/32143
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991703838
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 68a9370a785479b516bb58baf510fa6d2ea2f411 with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 15.3 seconds inserted 10000000 Rows, about 653K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991733017
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991732935
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991697307
<details>
<summary>ClickBench: <b>Total hot run time: 30.64 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 68a9370a785479b516bb58baf510fa6d2ea2f411, data reload: false
query1 0.04 0.04 0.04
query2 0.06 0.02 0.02
query3 0.22 0.06 0.06
query4 1.67 0.10 0.11
query5 0.49 0.50 0.49
query6 1.23 0.63 0.62
query7 0.02 0.01 0.02
query8 0.03 0.03 0.03
query9 0.54 0.48 0.49
query10 0.54 0.55 0.55
query11 0.12 0.09 0.10
query12 0.12 0.09 0.10
query13 0.57 0.56 0.57
query14 0.73 0.76 0.73
query15 0.81 0.78 0.78
query16 0.40 0.40 0.39
query17 1.01 1.04 1.08
query18 0.19 0.26 0.21
query19 1.81 1.69 1.77
query20 0.02 0.01 0.01
query21 15.40 0.56 0.55
query22 2.23 1.88 1.43
query23 17.22 0.84 0.75
query24 3.34 2.52 1.51
query25 0.07 0.27 0.11
query26 0.77 0.14 0.13
query27 0.03 0.03 0.03
query28 10.21 0.88 0.83
query29 12.72 3.25 3.31
query30 0.70 0.63 0.54
query31 2.80 0.33 0.37
query32 3.36 0.45 0.44
query33 2.87 2.79 2.87
query34 16.11 4.35 4.34
query35 4.33 4.36 4.33
query36 1.11 1.01 1.00
query37 0.07 0.06 0.05
query38 0.05 0.03 0.03
query39 0.02 0.02 0.02
query40 0.16 0.15 0.13
query41 0.07 0.02 0.02
query42 0.03 0.02 0.02
query43 0.02 0.02 0.03
Total cold run time: 104.31 s
Total hot run time: 30.64 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #32143:
URL: https://github.com/apache/doris/pull/32143
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "airborne12 (via GitHub)" <gi...@apache.org>.
airborne12 commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991593851
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991660928
<details>
<summary>TPC-H: <b>Total hot run time: 36241 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 68a9370a785479b516bb58baf510fa6d2ea2f411, data reload: false
------ Round 1 ----------------------------------
q1 17644 4109 4080 4080
q2 2019 149 146 146
q3 10574 896 877 877
q4 4648 677 670 670
q5 7594 2741 2787 2741
q6 185 124 128 124
q7 1184 815 796 796
q8 9470 1991 1983 1983
q9 7270 6497 6402 6402
q10 8114 2495 2468 2468
q11 427 227 214 214
q12 797 303 293 293
q13 17949 3028 2994 2994
q14 271 265 249 249
q15 495 450 453 450
q16 483 391 394 391
q17 942 542 507 507
q18 6623 5765 5725 5725
q19 1560 1392 1423 1392
q20 551 297 292 292
q21 7351 3232 3155 3155
q22 817 292 297 292
Total cold run time: 106968 ms
Total hot run time: 36241 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4053 4061 4098 4061
q2 325 233 234 233
q3 2937 2804 2791 2791
q4 1825 1497 1543 1497
q5 5187 5253 5210 5210
q6 192 114 118 114
q7 2223 1875 1858 1858
q8 3152 3277 3280 3277
q9 8503 8491 8505 8491
q10 6262 3670 3691 3670
q11 533 454 433 433
q12 764 574 583 574
q13 13211 2860 2882 2860
q14 278 248 268 248
q15 481 465 441 441
q16 456 426 409 409
q17 1712 1503 1470 1470
q18 7619 7239 7129 7129
q19 5835 1570 1491 1491
q20 1896 1742 1704 1704
q21 4905 4723 4849 4723
q22 524 477 435 435
Total cold run time: 72873 ms
Total hot run time: 53119 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991686305
<details>
<summary>TPC-DS: <b>Total hot run time: 186977 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 68a9370a785479b516bb58baf510fa6d2ea2f411, data reload: false
query1 942 376 366 366
query2 7585 2037 1866 1866
query3 6943 221 218 218
query4 32162 20597 20605 20597
query5 4313 458 396 396
query6 263 177 171 171
query7 4629 303 283 283
query8 228 166 168 166
query9 9982 2303 2301 2301
query10 444 237 247 237
query11 17249 14110 14067 14067
query12 130 83 77 77
query13 1619 399 412 399
query14 11430 10499 10627 10499
query15 285 214 186 186
query16 8106 262 263 262
query17 2145 570 541 541
query18 2110 300 291 291
query19 344 157 154 154
query20 93 82 84 82
query21 197 125 122 122
query22 4641 4488 4507 4488
query23 31989 31384 31111 31111
query24 10644 2774 2802 2774
query25 592 383 374 374
query26 1003 156 162 156
query27 2370 358 343 343
query28 7213 1901 1906 1901
query29 864 656 619 619
query30 306 156 148 148
query31 992 712 713 712
query32 94 61 54 54
query33 795 254 254 254
query34 1058 467 466 466
query35 827 620 604 604
query36 969 850 865 850
query37 117 77 78 77
query38 3359 3143 3161 3143
query39 1400 1397 1406 1397
query40 207 111 115 111
query41 49 47 47 47
query42 98 104 94 94
query43 493 445 449 445
query44 1252 721 700 700
query45 272 238 264 238
query46 1096 696 689 689
query47 1661 1614 1602 1602
query48 443 357 357 357
query49 1070 345 345 345
query50 762 377 370 370
query51 6553 6615 6625 6615
query52 102 101 91 91
query53 345 276 295 276
query54 308 230 249 230
query55 89 79 81 79
query56 247 240 234 234
query57 1100 1031 1015 1015
query58 229 209 200 200
query59 2894 2627 2529 2529
query60 273 246 258 246
query61 114 110 109 109
query62 600 430 416 416
query63 301 269 270 269
query64 5498 3985 4002 3985
query65 3027 3002 2975 2975
query66 855 315 327 315
query67 15068 14601 14354 14354
query68 6962 530 533 530
query69 608 383 386 383
query70 1270 1102 1174 1102
query71 523 273 280 273
query72 6701 2683 2486 2486
query73 720 339 327 327
query74 7091 6616 6580 6580
query75 10027 8071 8042 8042
query76 4625 968 989 968
query77 735 250 248 248
query78 10303 9611 9515 9515
query79 13253 520 504 504
query80 1478 371 389 371
query81 525 212 210 210
query82 1482 203 203 203
query83 201 144 141 141
query84 286 78 78 78
query85 1406 337 313 313
query86 457 265 299 265
query87 3413 3239 3183 3183
query88 5500 2374 2348 2348
query89 535 365 374 365
query90 2078 190 170 170
query91 157 127 127 127
query92 57 46 47 46
query93 7601 513 499 499
query94 1326 177 173 173
query95 438 330 321 321
query96 615 277 271 271
query97 4419 4292 4293 4292
query98 245 209 211 209
query99 1101 762 746 746
Total cold run time: 321576 ms
Total hot run time: 186977 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Fix](cloud) fix build index for cloud mode [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #32143:
URL: https://github.com/apache/doris/pull/32143#issuecomment-1991593502
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org