You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "dataroaring (via GitHub)" <gi...@apache.org> on 2024/10/23 05:05:44 UTC
[PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
dataroaring opened a new pull request, #42311:
URL: https://github.com/apache/doris/pull/42311
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42311:
URL: https://github.com/apache/doris/pull/42311#issuecomment-2430976798
<details>
<summary>ClickBench: <b>Total hot run time: 31.59 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6bdf379fca4690b08515f2f3c52608b3afba5d0f, data reload: false
query1 0.02 0.02 0.03
query2 0.06 0.03 0.02
query3 0.25 0.06 0.05
query4 1.78 0.07 0.06
query5 0.54 0.52 0.52
query6 1.23 0.63 0.61
query7 0.02 0.00 0.01
query8 0.03 0.02 0.02
query9 0.52 0.48 0.48
query10 0.53 0.53 0.54
query11 0.12 0.09 0.09
query12 0.12 0.10 0.09
query13 0.62 0.61 0.61
query14 0.78 0.78 0.79
query15 0.78 0.75 0.75
query16 0.37 0.37 0.38
query17 0.97 1.02 1.02
query18 0.22 0.26 0.24
query19 1.86 1.86 1.84
query20 0.01 0.02 0.01
query21 15.48 0.56 0.56
query22 2.07 1.85 1.94
query23 17.33 1.02 1.08
query24 4.04 1.68 1.55
query25 0.39 0.06 0.04
query26 0.57 0.15 0.15
query27 0.04 0.04 0.04
query28 7.94 0.75 0.71
query29 12.63 2.24 2.35
query30 0.57 0.52 0.52
query31 2.79 0.38 0.36
query32 3.41 0.50 0.50
query33 3.08 3.06 3.06
query34 15.28 4.80 4.79
query35 4.86 4.86 4.84
query36 1.06 1.01 1.01
query37 0.06 0.04 0.05
query38 0.04 0.02 0.02
query39 0.02 0.02 0.01
query40 0.16 0.14 0.14
query41 0.07 0.02 0.01
query42 0.02 0.01 0.01
query43 0.03 0.01 0.02
Total cold run time: 102.77 s
Total hot run time: 31.59 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42311:
URL: https://github.com/apache/doris/pull/42311#issuecomment-2430968959
<details>
<summary>TPC-DS: <b>Total hot run time: 211562 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6bdf379fca4690b08515f2f3c52608b3afba5d0f, data reload: false
query1 941 394 416 394
query2 6551 2245 2040 2040
query3 6922 202 201 201
query4 23299 22137 21762 21762
query5 19730 6447 6537 6447
query6 290 222 242 222
query7 4332 295 300 295
query8 276 277 246 246
query9 3029 2622 2557 2557
query10 481 319 310 310
query11 15688 15488 14898 14898
query12 122 79 81 79
query13 1037 448 454 448
query14 17809 13212 13539 13212
query15 389 224 225 224
query16 5699 304 262 262
query17 1583 918 919 918
query18 894 324 324 324
query19 212 145 153 145
query20 116 103 103 103
query21 187 105 98 98
query22 5381 5036 5127 5036
query23 34135 33370 33467 33370
query24 7468 6352 6315 6315
query25 532 426 413 413
query26 1234 163 162 162
query27 2354 297 294 294
query28 6121 2244 2203 2203
query29 2908 2857 2744 2744
query30 245 170 166 166
query31 943 740 730 730
query32 70 65 58 58
query33 442 271 268 268
query34 865 470 464 464
query35 1181 892 902 892
query36 1350 1022 1317 1022
query37 91 63 62 62
query38 3084 2960 2926 2926
query39 1369 1332 1305 1305
query40 310 91 96 91
query41 40 39 37 37
query42 91 85 82 82
query43 621 567 639 567
query44 1242 730 731 730
query45 246 224 231 224
query46 1233 990 963 963
query47 1872 1661 1774 1661
query48 503 414 413 413
query49 646 386 392 386
query50 867 613 618 613
query51 4807 4709 4669 4669
query52 96 75 82 75
query53 222 190 189 189
query54 2665 2440 2490 2440
query55 84 78 81 78
query56 225 210 214 210
query57 1247 1184 1098 1098
query58 225 218 211 211
query59 3587 3308 3231 3231
query60 221 209 225 209
query61 104 108 103 103
query62 861 436 451 436
query63 195 187 182 182
query64 3679 1616 1297 1297
query65 3643 3537 3565 3537
query66 813 413 398 398
query67 15753 15364 15951 15364
query68 9557 658 641 641
query69 498 289 261 261
query70 1624 1688 1268 1268
query71 413 313 315 313
query72 6905 4853 4525 4525
query73 759 322 321 321
query74 6215 5874 5856 5856
query75 5448 3740 3634 3634
query76 5515 1137 1230 1137
query77 929 274 263 263
query78 12768 11608 12054 11608
query79 6606 633 619 619
query80 1252 395 384 384
query81 482 237 240 237
query82 1738 94 99 94
query83 168 134 132 132
query84 257 73 70 70
query85 896 328 329 328
query86 346 292 291 291
query87 3245 2999 2961 2961
query88 4639 2296 2300 2296
query89 398 285 297 285
query90 1971 221 217 217
query91 159 129 125 125
query92 63 54 51 51
query93 5124 558 556 556
query94 715 214 210 210
query95 2052 2049 2059 2049
query96 635 327 325 325
query97 6516 6398 6466 6398
query98 218 208 219 208
query99 2619 790 867 790
Total cold run time: 316188 ms
Total hot run time: 211562 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #42311:
URL: https://github.com/apache/doris/pull/42311#issuecomment-2430913875
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42311:
URL: https://github.com/apache/doris/pull/42311#issuecomment-2430952520
<details>
<summary>TPC-H: <b>Total hot run time: 49723 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6bdf379fca4690b08515f2f3c52608b3afba5d0f, data reload: false
------ Round 1 ----------------------------------
q1 17655 4367 4378 4367
q2 2085 156 139 139
q3 10272 1894 1963 1894
q4 10404 1285 1306 1285
q5 8516 3937 3944 3937
q6 236 120 124 120
q7 2079 1639 1615 1615
q8 9493 2757 2726 2726
q9 10565 10143 9959 9959
q10 8835 3586 3534 3534
q11 420 243 261 243
q12 471 300 297 297
q13 18452 4149 4170 4149
q14 380 331 333 331
q15 526 469 473 469
q16 552 480 481 480
q17 1173 1002 976 976
q18 7609 7325 6925 6925
q19 3657 1498 1489 1489
q20 1008 328 311 311
q21 4520 4197 4088 4088
q22 483 389 407 389
Total cold run time: 119391 ms
Total hot run time: 49723 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4359 4305 4282 4282
q2 321 229 222 222
q3 4197 4151 4151 4151
q4 2740 2738 2732 2732
q5 7262 7189 7180 7180
q6 238 124 120 120
q7 3272 2903 2856 2856
q8 4364 4462 4507 4462
q9 14267 14033 14020 14020
q10 4233 4242 4263 4242
q11 744 693 704 693
q12 1018 868 851 851
q13 6716 3724 3741 3724
q14 453 435 434 434
q15 500 456 463 456
q16 636 589 571 571
q17 3810 3842 3818 3818
q18 8834 8752 8643 8643
q19 1728 1647 1687 1647
q20 2346 2114 2122 2114
q21 8476 8528 8496 8496
q22 1031 949 949 949
Total cold run time: 81545 ms
Total hot run time: 76663 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #42311:
URL: https://github.com/apache/doris/pull/42311
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42311:
URL: https://github.com/apache/doris/pull/42311#issuecomment-2430980648
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 6bdf379fca4690b08515f2f3c52608b3afba5d0f with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 22.0 seconds inserted 10000000 Rows, about 454K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [enhancement](bakcup) throw detailed msg for backup or restore (#42288) [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #42311:
URL: https://github.com/apache/doris/pull/42311#issuecomment-2430913820
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org