You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Jibing-Li (via GitHub)" <gi...@apache.org> on 2024/02/29 11:43:12 UTC
[PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Jibing-Li opened a new pull request, #31619:
URL: https://github.com/apache/doris/pull/31619
Log one bdbje record for one load transaction. Reduce the log bdbje operation for load.
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1970989850
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971109620
<details>
<summary>ClickBench: <b>Total hot run time: 31.75 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d, data reload: false
query1 0.04 0.03 0.03
query2 0.06 0.02 0.02
query3 0.23 0.06 0.06
query4 1.67 0.09 0.09
query5 0.53 0.51 0.52
query6 1.27 0.68 0.66
query7 0.01 0.02 0.01
query8 0.03 0.02 0.03
query9 0.56 0.52 0.51
query10 0.59 0.57 0.56
query11 0.13 0.10 0.10
query12 0.13 0.10 0.11
query13 0.62 0.61 0.62
query14 0.79 0.79 0.80
query15 0.84 0.81 0.82
query16 0.38 0.38 0.37
query17 0.97 0.95 0.97
query18 0.26 0.26 0.24
query19 1.79 1.70 1.66
query20 0.01 0.01 0.01
query21 15.41 0.67 0.62
query22 3.03 4.16 2.32
query23 17.75 1.09 0.97
query24 2.22 0.20 0.35
query25 0.25 0.11 0.05
query26 0.17 0.15 0.14
query27 0.03 0.02 0.03
query28 12.47 0.84 0.83
query29 12.62 3.29 3.23
query30 0.61 0.54 0.54
query31 2.80 0.35 0.36
query32 3.34 0.49 0.47
query33 3.18 3.16 3.26
query34 15.35 4.73 4.71
query35 4.75 4.72 4.71
query36 1.13 1.06 1.07
query37 0.06 0.05 0.05
query38 0.04 0.03 0.02
query39 0.02 0.02 0.01
query40 0.18 0.14 0.15
query41 0.07 0.01 0.02
query42 0.03 0.01 0.02
query43 0.03 0.02 0.02
Total cold run time: 106.45 s
Total hot run time: 31.75 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972693820
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971081624
<details>
<summary>TPC-H: <b>Total hot run time: 38206 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d, data reload: false
------ Round 1 ----------------------------------
q1 17667 5816 4143 4143
q2 2053 142 136 136
q3 10979 970 969 969
q4 4704 980 992 980
q5 8670 2880 3055 2880
q6 180 125 123 123
q7 1255 774 768 768
q8 9297 1990 2048 1990
q9 7252 6348 6276 6276
q10 8193 2502 2492 2492
q11 432 214 195 195
q12 739 312 316 312
q13 17981 3215 3224 3215
q14 277 242 281 242
q15 532 499 484 484
q16 523 389 406 389
q17 951 872 857 857
q18 6316 6180 6190 6180
q19 1580 1517 1516 1516
q20 477 283 268 268
q21 5812 3519 3591 3519
q22 796 286 272 272
Total cold run time: 106666 ms
Total hot run time: 38206 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4101 4006 4013 4006
q2 302 216 210 210
q3 2992 2931 2932 2931
q4 1848 1811 1783 1783
q5 5114 5158 5121 5121
q6 205 115 116 115
q7 2113 1730 1744 1730
q8 3130 3237 3222 3222
q9 8230 8259 8217 8217
q10 6200 3652 3641 3641
q11 513 430 425 425
q12 674 534 525 525
q13 3743 3063 3062 3062
q14 275 270 244 244
q15 545 502 493 493
q16 499 484 461 461
q17 1705 1688 1704 1688
q18 7784 7597 7355 7355
q19 1741 1641 1642 1641
q20 2093 1904 1893 1893
q21 4745 4642 4917 4642
q22 500 437 436 436
Total cold run time: 59052 ms
Total hot run time: 53841 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972717263
<details>
<summary>ClickBench: <b>Total hot run time: 27.11 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b18e49935ed898751995c35b91593bd382da247e, data reload: false
query1 0.06 0.04 0.04
query2 0.10 0.04 0.03
query3 0.27 0.06 0.07
query4 1.60 0.09 0.09
query5 0.51 0.51 0.51
query6 1.57 1.01 0.99
query7 0.03 0.02 0.02
query8 0.06 0.04 0.04
query9 0.70 0.66 0.69
query10 0.70 0.71 0.68
query11 0.21 0.15 0.16
query12 0.20 0.15 0.15
query13 0.50 0.49 0.46
query14 0.75 0.71 0.70
query15 0.92 0.86 0.86
query16 0.41 0.39 0.40
query17 1.19 1.18 1.31
query18 0.33 0.29 0.29
query19 2.21 2.04 2.08
query20 0.02 0.02 0.02
query21 15.38 1.06 0.98
query22 0.61 0.59 0.59
query23 13.65 0.66 0.65
query24 0.60 0.19 0.18
query25 0.05 0.05 0.05
query26 0.21 0.20 0.20
query27 0.05 0.05 0.04
query28 1.37 0.75 0.76
query29 13.06 4.69 4.76
query30 0.88 0.78 0.83
query31 0.86 0.40 0.40
query32 3.24 0.41 0.40
query33 2.50 2.30 2.26
query34 2.23 2.20 2.20
query35 2.22 2.19 2.19
query36 1.02 1.02 1.00
query37 0.08 0.06 0.06
query38 0.05 0.04 0.04
query39 0.03 0.03 0.03
query40 0.21 0.16 0.17
query41 0.09 0.03 0.03
query42 0.04 0.04 0.03
query43 0.04 0.04 0.05
Total cold run time: 70.81 s
Total hot run time: 27.11 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972693860
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1970960259
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972574118
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971100383
<details>
<summary>TPC-DS: <b>Total hot run time: 168346 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d, data reload: false
query1 923 354 334 334
query2 6526 1749 1677 1677
query3 6701 209 202 202
query4 23258 20466 20562 20466
query5 4250 366 350 350
query6 260 163 173 163
query7 4605 287 294 287
query8 262 188 193 188
query9 8510 2302 2282 2282
query10 418 211 225 211
query11 14483 14300 14033 14033
query12 139 81 79 79
query13 1651 424 414 414
query14 8593 6242 6477 6242
query15 204 163 172 163
query16 7086 255 248 248
query17 1045 530 499 499
query18 1895 270 269 269
query19 186 149 152 149
query20 83 82 81 81
query21 198 120 115 115
query22 4565 4531 4629 4531
query23 30478 29945 29838 29838
query24 11404 3070 3132 3070
query25 621 353 350 350
query26 1704 153 161 153
query27 3025 303 317 303
query28 7044 1855 1848 1848
query29 1104 549 555 549
query30 278 130 141 130
query31 859 673 693 673
query32 91 57 54 54
query33 711 220 224 220
query34 1043 481 480 480
query35 854 735 729 729
query36 945 898 885 885
query37 139 64 62 62
query38 3081 2955 2987 2955
query39 1314 1272 1243 1243
query40 280 101 100 100
query41 42 36 36 36
query42 104 96 97 96
query43 458 420 428 420
query44 1071 690 697 690
query45 183 174 172 172
query46 1039 789 777 777
query47 1536 1417 1444 1417
query48 419 347 348 347
query49 1146 294 302 294
query50 755 361 364 361
query51 4387 4312 4276 4276
query52 91 88 87 87
query53 328 262 262 262
query54 296 222 219 219
query55 85 76 79 76
query56 219 203 192 192
query57 959 901 911 901
query58 210 188 193 188
query59 2015 1971 2072 1971
query60 229 224 207 207
query61 85 92 86 86
query62 608 366 367 366
query63 270 261 266 261
query64 6602 2997 3144 2997
query65 3231 3185 3195 3185
query66 1436 315 315 315
query67 14399 14173 13992 13992
query68 4609 570 568 568
query69 520 375 373 373
query70 1248 1201 1239 1201
query71 330 255 241 241
query72 6294 2801 2661 2661
query73 708 320 316 316
query74 6348 5936 5962 5936
query75 3041 2423 2403 2403
query76 2723 1011 1122 1011
query77 337 236 231 231
query78 9019 8394 8539 8394
query79 1287 526 523 523
query80 1008 348 337 337
query81 478 200 193 193
query82 940 85 83 83
query83 218 125 122 122
query84 277 74 78 74
query85 1342 353 345 345
query86 357 306 306 306
query87 3248 3080 3035 3035
query88 2681 2285 2301 2285
query89 374 349 327 327
query90 1851 160 165 160
query91 152 145 137 137
query92 55 48 46 46
query93 1128 515 500 500
query94 1246 182 177 177
query95 439 332 340 332
query96 571 260 262 260
query97 4223 4112 4121 4112
query98 222 208 195 195
query99 1042 646 689 646
Total cold run time: 261335 ms
Total hot run time: 168346 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972698093
<details>
<summary>TPC-H: <b>Total hot run time: 31686 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b18e49935ed898751995c35b91593bd382da247e, data reload: false
------ Round 1 ----------------------------------
q1 17929 4589 4605 4589
q2 2186 228 220 220
q3 10377 1063 1045 1045
q4 4689 1081 1074 1074
q5 7697 2043 2015 2015
q6 159 137 107 107
q7 1139 1042 1012 1012
q8 9521 1058 1108 1058
q9 6191 4992 4734 4734
q10 7797 1949 1945 1945
q11 524 319 326 319
q12 791 391 399 391
q13 18061 3102 2889 2889
q14 308 312 278 278
q15 353 334 330 330
q16 519 482 524 482
q17 811 330 332 330
q18 5509 4811 4705 4705
q19 1184 440 441 440
q20 615 432 419 419
q21 6063 2838 2851 2838
q22 539 466 466 466
Total cold run time: 102962 ms
Total hot run time: 31686 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4579 4612 4676 4612
q2 297 214 228 214
q3 2124 1739 1746 1739
q4 1540 1247 1215 1215
q5 3078 2847 2833 2833
q6 162 105 110 105
q7 1803 1810 1781 1781
q8 1839 1721 1715 1715
q9 5273 5133 5113 5113
q10 2590 2264 2322 2264
q11 491 419 444 419
q12 691 613 625 613
q13 2942 2623 2651 2623
q14 290 292 300 292
q15 364 337 329 329
q16 508 509 489 489
q17 1190 783 778 778
q18 5890 5397 5215 5215
q19 1155 677 651 651
q20 1495 1473 1424 1424
q21 4640 4267 4188 4188
q22 666 611 581 581
Total cold run time: 43607 ms
Total hot run time: 39193 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972711591
<details>
<summary>TPC-DS: <b>Total hot run time: 188550 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b18e49935ed898751995c35b91593bd382da247e, data reload: false
query1 1036 402 386 386
query2 7907 2449 2464 2449
query3 6741 301 306 301
query4 21156 22354 23156 22354
query5 5614 947 752 752
query6 380 279 280 279
query7 4965 435 454 435
query8 312 242 257 242
query9 8697 3431 3390 3390
query10 561 364 369 364
query11 18214 19067 19697 19067
query12 302 273 267 267
query13 1714 646 664 646
query14 11625 7941 7659 7659
query15 324 231 249 231
query16 8392 400 399 399
query17 2200 727 724 724
query18 2212 396 401 396
query19 490 245 238 238
query20 140 136 137 136
query21 240 185 162 162
query22 5138 5009 4963 4963
query23 24071 23377 23936 23377
query24 6882 2128 2100 2100
query25 692 522 533 522
query26 794 250 254 250
query27 2258 492 499 492
query28 3272 2872 2860 2860
query29 958 780 765 765
query30 410 187 199 187
query31 1400 768 810 768
query32 142 102 98 98
query33 607 387 385 385
query34 895 657 667 657
query35 970 906 898 898
query36 1238 1181 1172 1172
query37 147 115 115 115
query38 3186 3063 3006 3006
query39 1122 1059 1114 1059
query40 257 176 170 170
query41 99 86 92 86
query42 164 162 152 152
query43 616 589 598 589
query44 1285 1085 1059 1059
query45 223 228 222 222
query46 893 791 811 791
query47 1637 1621 1626 1621
query48 608 517 530 517
query49 1115 499 472 472
query50 666 563 565 563
query51 11664 11295 11533 11295
query52 154 144 149 144
query53 350 337 335 335
query54 383 356 373 356
query55 166 138 130 130
query56 364 355 346 346
query57 1091 1044 1011 1011
query58 371 351 338 338
query59 3499 3360 3451 3360
query60 408 387 424 387
query61 172 194 171 171
query62 543 432 422 422
query63 353 347 332 332
query64 4270 1849 1837 1837
query65 2383 2399 2372 2372
query66 900 398 393 393
query67 15038 14939 14901 14901
query68 4189 737 722 722
query69 673 581 585 581
query70 1628 1601 1590 1590
query71 485 419 430 419
query72 2878 2348 2380 2348
query73 664 483 490 483
query74 6956 7080 7049 7049
query75 2962 2732 2718 2718
query76 2230 662 656 656
query77 567 415 414 414
query78 6876 6170 6255 6170
query79 1116 749 784 749
query80 662 712 602 602
query81 492 255 264 255
query82 168 139 137 137
query83 259 281 270 270
query84 281 134 135 134
query85 896 580 532 532
query86 440 421 477 421
query87 3445 3082 3149 3082
query88 3747 3490 3455 3455
query89 461 431 421 421
query90 1054 232 238 232
query91 220 208 219 208
query92 88 87 85 85
query93 1034 723 723 723
query94 501 279 281 279
query95 595 536 527 527
query96 640 392 400 392
query97 2976 2968 2974 2968
query98 339 300 300 300
query99 832 705 731 705
Total cold run time: 257430 ms
Total hot run time: 188550 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #31619:
URL: https://github.com/apache/doris/pull/31619
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972591125
<details>
<summary>TPC-H: <b>Total hot run time: 37834 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 21b295a3eb54221f15be882424adb84bd92b1984, data reload: false
------ Round 1 ----------------------------------
q1 17707 4166 3988 3988
q2 2081 154 145 145
q3 10653 933 934 933
q4 4699 935 936 935
q5 7647 2864 3001 2864
q6 185 124 124 124
q7 1288 816 824 816
q8 9609 2071 2073 2071
q9 7347 6445 6488 6445
q10 8229 2570 2573 2570
q11 434 217 217 217
q12 836 309 310 309
q13 17994 2963 2945 2945
q14 296 253 254 253
q15 474 463 436 436
q16 455 387 390 387
q17 933 850 819 819
q18 6558 5934 5888 5888
q19 1577 1504 1512 1504
q20 539 281 262 262
q21 7512 3622 3632 3622
q22 799 305 301 301
Total cold run time: 107852 ms
Total hot run time: 37834 ms
----- Round 2, with runtime_filter_mode=off -----
q1 3970 3985 3979 3979
q2 316 219 222 219
q3 2912 2902 2896 2896
q4 1832 1797 1795 1795
q5 5195 5276 5199 5199
q6 200 116 118 116
q7 2244 1794 1781 1781
q8 3178 3289 3274 3274
q9 8470 8423 8469 8423
q10 6156 3760 3705 3705
q11 528 432 448 432
q12 663 514 564 514
q13 7806 2854 2818 2818
q14 269 274 246 246
q15 469 432 433 432
q16 446 399 410 399
q17 1687 1666 1651 1651
q18 7890 7597 7312 7312
q19 2623 1498 1602 1498
q20 1917 1717 1725 1717
q21 4901 4841 4685 4685
q22 517 485 454 454
Total cold run time: 64189 ms
Total hot run time: 53545 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "Jibing-Li (via GitHub)" <gi...@apache.org>.
Jibing-Li commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1972639237
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](statistics)Log one bdbje record for one load transaction. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31619:
URL: https://github.com/apache/doris/pull/31619#issuecomment-1971114714
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 234cf9743b9f984f7c27daeb178723d7d3f8934d with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 18.1 seconds inserted 10000000 Rows, about 552K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org