You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "liutang123 (via GitHub)" <gi...@apache.org> on 2024/06/16 17:13:42 UTC
[PR] [opt](meta) Recycle partition when replace partition [doris]
liutang123 opened a new pull request, #36361:
URL: https://github.com/apache/doris/pull/36361
## Proposed changes
Issue Number: close #xxx
Move the old partitions to recycle bin when replacing partition.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put old partitions into recyclebin when replace partition [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2172539625
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2205021732
<details>
<summary>TPC-DS: <b>Total hot run time: 173200 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 35210d8492e7e5e528c8d4346dde19d270998514, data reload: false
query1 2192 384 387 384
query2 7965 2432 2285 2285
query3 9684 207 213 207
query4 19021 17566 17290 17290
query5 3809 490 456 456
query6 247 195 153 153
query7 4587 293 281 281
query8 339 306 300 300
query9 8440 2366 2356 2356
query10 564 306 282 282
query11 10665 9847 9935 9847
query12 117 88 85 85
query13 1648 384 375 375
query14 10364 7070 7218 7070
query15 265 188 184 184
query16 8065 269 264 264
query17 1910 524 525 524
query18 2107 263 272 263
query19 309 153 159 153
query20 89 85 81 81
query21 209 131 126 126
query22 4338 3917 3923 3917
query23 34025 33492 33487 33487
query24 10202 2861 2967 2861
query25 592 390 368 368
query26 704 167 162 162
query27 2154 324 341 324
query28 6069 2159 2130 2130
query29 886 670 650 650
query30 244 164 166 164
query31 1001 775 743 743
query32 99 56 53 53
query33 657 285 283 283
query34 895 501 511 501
query35 765 629 643 629
query36 1176 998 998 998
query37 140 80 75 75
query38 2912 2874 2843 2843
query39 898 839 828 828
query40 208 135 127 127
query41 57 50 52 50
query42 109 100 99 99
query43 608 562 548 548
query44 1095 725 750 725
query45 201 164 162 162
query46 1087 702 710 702
query47 1821 1770 1738 1738
query48 374 304 309 304
query49 844 408 411 408
query50 776 385 380 380
query51 6924 6847 6706 6706
query52 111 96 94 94
query53 375 297 296 296
query54 868 449 445 445
query55 74 70 73 70
query56 301 267 267 267
query57 1148 1059 1068 1059
query58 257 255 251 251
query59 3468 3213 3336 3213
query60 299 274 280 274
query61 96 89 94 89
query62 600 440 420 420
query63 323 298 293 293
query64 8641 2212 1748 1748
query65 3150 3098 3097 3097
query66 756 315 326 315
query67 15499 14912 14742 14742
query68 5151 545 544 544
query69 654 440 322 322
query70 1171 1144 1109 1109
query71 447 277 279 277
query72 7238 5701 5372 5372
query73 784 331 321 321
query74 5901 5474 5450 5450
query75 3799 2609 2697 2609
query76 3523 1012 927 927
query77 607 295 295 295
query78 10355 10050 9686 9686
query79 2726 501 514 501
query80 1430 481 470 470
query81 553 216 226 216
query82 781 115 107 107
query83 190 169 168 168
query84 269 90 87 87
query85 1245 278 268 268
query86 455 291 293 291
query87 3286 3089 3077 3077
query88 4066 2441 2455 2441
query89 483 411 409 409
query90 1768 191 191 191
query91 126 99 98 98
query92 60 51 50 50
query93 3075 515 508 508
query94 1022 189 183 183
query95 406 316 317 316
query96 616 279 269 269
query97 3162 3022 3004 3004
query98 224 198 193 193
query99 1216 869 837 837
Total cold run time: 277212 ms
Total hot run time: 173200 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2185145501
<details>
<summary>ClickBench: <b>Total hot run time: 30.99 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a73ffccfd7f218ce793e2d421514c08f84923707, data reload: false
query1 0.05 0.03 0.03
query2 0.09 0.04 0.04
query3 0.23 0.05 0.05
query4 1.68 0.08 0.08
query5 0.50 0.47 0.48
query6 1.15 0.72 0.72
query7 0.02 0.02 0.01
query8 0.05 0.05 0.04
query9 0.56 0.49 0.50
query10 0.54 0.54 0.54
query11 0.16 0.11 0.11
query12 0.15 0.12 0.13
query13 0.59 0.60 0.60
query14 0.77 0.81 0.77
query15 0.84 0.81 0.83
query16 0.37 0.36 0.36
query17 0.97 0.98 1.02
query18 0.23 0.24 0.25
query19 1.84 1.72 1.71
query20 0.01 0.01 0.01
query21 15.42 0.67 0.66
query22 4.24 7.19 2.24
query23 18.32 1.36 1.26
query24 2.11 0.23 0.23
query25 0.16 0.09 0.09
query26 0.26 0.17 0.18
query27 0.07 0.09 0.08
query28 13.25 1.02 0.99
query29 12.58 3.32 3.28
query30 0.30 0.07 0.08
query31 3.30 0.40 0.39
query32 3.30 0.47 0.47
query33 2.83 2.89 2.90
query34 17.06 4.43 4.47
query35 4.48 4.47 4.56
query36 0.66 0.46 0.47
query37 0.19 0.16 0.16
query38 0.16 0.15 0.15
query39 0.04 0.04 0.04
query40 0.17 0.14 0.14
query41 0.10 0.05 0.05
query42 0.06 0.06 0.05
query43 0.04 0.04 0.04
Total cold run time: 109.9 s
Total hot run time: 30.99 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2203188773
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2204970187
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put old partitions into recyclebin when replace partition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2172622966
<details>
<summary>TPC-DS: <b>Total hot run time: 173985 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 862df4fa7f2afbf07ff971cbc3bea728c665b117, data reload: false
query1 925 380 373 373
query2 6461 2441 2352 2352
query3 6630 202 204 202
query4 19191 17354 17233 17233
query5 3581 496 509 496
query6 240 161 158 158
query7 4592 304 293 293
query8 318 298 281 281
query9 8539 2383 2380 2380
query10 565 299 283 283
query11 10585 10008 10106 10008
query12 123 92 87 87
query13 1647 377 356 356
query14 9566 7091 7844 7091
query15 255 185 189 185
query16 7753 271 260 260
query17 1705 539 523 523
query18 1950 281 276 276
query19 208 156 169 156
query20 99 92 89 89
query21 214 129 129 129
query22 4260 4040 4039 4039
query23 33895 33792 33839 33792
query24 11054 2890 3000 2890
query25 620 393 378 378
query26 1251 165 162 162
query27 2506 325 336 325
query28 7186 2099 2104 2099
query29 887 624 658 624
query30 246 160 159 159
query31 963 750 762 750
query32 95 54 59 54
query33 786 331 278 278
query34 1055 501 507 501
query35 746 619 641 619
query36 1124 943 958 943
query37 152 71 71 71
query38 2943 2841 2805 2805
query39 926 857 846 846
query40 207 134 133 133
query41 63 54 53 53
query42 139 104 108 104
query43 608 558 565 558
query44 1311 730 740 730
query45 193 161 164 161
query46 1067 710 737 710
query47 1886 1764 1740 1740
query48 380 299 289 289
query49 857 401 420 401
query50 779 405 389 389
query51 6662 6709 6659 6659
query52 110 92 95 92
query53 360 300 297 297
query54 923 445 443 443
query55 76 76 73 73
query56 287 261 263 261
query57 1140 1028 1030 1028
query58 243 257 249 249
query59 3402 3262 3282 3262
query60 299 270 282 270
query61 96 86 87 86
query62 593 456 473 456
query63 318 294 298 294
query64 8829 2300 1829 1829
query65 3190 3079 3122 3079
query66 735 326 324 324
query67 15274 14891 14932 14891
query68 4502 543 555 543
query69 550 416 378 378
query70 1189 1101 1172 1101
query71 426 273 278 273
query72 7049 5527 5262 5262
query73 770 327 328 327
query74 5902 5518 5494 5494
query75 3399 2672 2719 2672
query76 2397 929 965 929
query77 477 305 299 299
query78 10244 9997 9672 9672
query79 2272 524 509 509
query80 2246 480 464 464
query81 605 218 223 218
query82 1067 109 102 102
query83 317 176 169 169
query84 263 89 84 84
query85 1257 286 271 271
query86 464 324 332 324
query87 3274 3141 3063 3063
query88 3025 2350 2341 2341
query89 483 412 392 392
query90 1692 197 190 190
query91 129 98 104 98
query92 60 51 49 49
query93 1972 510 514 510
query94 1133 190 185 185
query95 400 327 320 320
query96 595 263 269 263
query97 3247 3093 3062 3062
query98 227 205 197 197
query99 1383 817 841 817
Total cold run time: 268885 ms
Total hot run time: 173985 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #36361:
URL: https://github.com/apache/doris/pull/36361
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) Recycle partition when replace partition [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2172017701
Please handle truncate too, and add regression test.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2205034087
<details>
<summary>ClickBench: <b>Total hot run time: 30.48 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 35210d8492e7e5e528c8d4346dde19d270998514, data reload: false
query1 0.04 0.03 0.03
query2 0.09 0.04 0.03
query3 0.23 0.05 0.04
query4 1.67 0.07 0.07
query5 0.49 0.48 0.47
query6 1.14 0.72 0.73
query7 0.02 0.02 0.02
query8 0.05 0.04 0.05
query9 0.55 0.49 0.49
query10 0.53 0.53 0.55
query11 0.16 0.12 0.12
query12 0.15 0.12 0.12
query13 0.59 0.58 0.59
query14 0.79 0.78 0.80
query15 0.86 0.82 0.81
query16 0.37 0.37 0.37
query17 1.05 1.00 0.98
query18 0.23 0.26 0.22
query19 1.93 1.70 1.81
query20 0.01 0.01 0.01
query21 15.46 0.77 0.66
query22 4.34 7.23 1.91
query23 18.29 1.37 1.23
query24 2.10 0.22 0.23
query25 0.16 0.09 0.09
query26 0.27 0.18 0.17
query27 0.08 0.07 0.08
query28 13.28 1.01 1.00
query29 12.62 3.26 3.23
query30 0.26 0.06 0.06
query31 2.86 0.39 0.38
query32 3.29 0.48 0.47
query33 2.85 2.93 2.92
query34 17.02 4.41 4.39
query35 4.43 4.49 4.50
query36 0.64 0.48 0.47
query37 0.18 0.16 0.15
query38 0.15 0.16 0.15
query39 0.05 0.03 0.04
query40 0.16 0.15 0.14
query41 0.10 0.04 0.05
query42 0.06 0.04 0.05
query43 0.05 0.04 0.04
Total cold run time: 109.65 s
Total hot run time: 30.48 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2185117994
<details>
<summary>TPC-DS: <b>Total hot run time: 174515 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a73ffccfd7f218ce793e2d421514c08f84923707, data reload: false
query1 916 389 377 377
query2 6461 2354 2255 2255
query3 6648 212 215 212
query4 18953 17377 17441 17377
query5 4146 473 488 473
query6 251 163 160 160
query7 4594 297 300 297
query8 298 279 275 275
query9 8497 2374 2347 2347
query10 632 298 281 281
query11 10639 10076 10136 10076
query12 135 87 85 85
query13 1637 362 377 362
query14 10008 7724 7559 7559
query15 239 208 182 182
query16 7814 271 291 271
query17 1865 572 539 539
query18 1873 284 292 284
query19 205 173 162 162
query20 97 88 86 86
query21 210 136 128 128
query22 4350 4105 4032 4032
query23 33618 33110 33064 33064
query24 11677 2860 2878 2860
query25 676 392 389 389
query26 1570 158 155 155
query27 2908 328 326 326
query28 7381 2076 2072 2072
query29 1038 653 621 621
query30 276 157 156 156
query31 988 768 785 768
query32 106 56 57 56
query33 787 315 299 299
query34 907 473 468 468
query35 777 626 635 626
query36 1088 952 940 940
query37 166 75 71 71
query38 2905 2740 2756 2740
query39 884 811 787 787
query40 290 136 132 132
query41 59 59 54 54
query42 126 105 106 105
query43 570 541 519 519
query44 1202 743 751 743
query45 203 172 172 172
query46 1094 741 747 741
query47 1874 1817 1837 1817
query48 387 306 305 305
query49 1153 425 443 425
query50 777 405 395 395
query51 6923 6877 6749 6749
query52 104 103 93 93
query53 365 292 294 292
query54 1039 457 468 457
query55 77 76 75 75
query56 325 287 284 284
query57 1150 1068 1095 1068
query58 261 264 254 254
query59 3303 3207 3150 3150
query60 338 304 296 296
query61 116 116 114 114
query62 690 454 457 454
query63 321 293 298 293
query64 10026 2361 1890 1890
query65 3212 3092 3117 3092
query66 1396 347 352 347
query67 15783 15027 15032 15027
query68 8264 554 555 554
query69 686 455 433 433
query70 1238 1149 1077 1077
query71 511 275 268 268
query72 8871 5864 5410 5410
query73 884 331 332 331
query74 5928 5506 5463 5463
query75 5204 2645 2643 2643
query76 4935 982 878 878
query77 757 321 303 303
query78 10653 9843 9760 9760
query79 8218 520 520 520
query80 1016 491 508 491
query81 545 225 227 225
query82 766 108 101 101
query83 351 170 176 170
query84 271 87 88 87
query85 1421 296 274 274
query86 398 313 319 313
query87 3308 3098 3153 3098
query88 4676 2465 2450 2450
query89 550 390 375 375
query90 1956 194 197 194
query91 136 101 136 101
query92 61 49 49 49
query93 6513 525 517 517
query94 1209 191 194 191
query95 403 318 321 318
query96 614 278 272 272
query97 3215 3041 3121 3041
query98 221 204 194 194
query99 1292 853 856 853
Total cold run time: 296455 ms
Total hot run time: 174515 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2185102786
<details>
<summary>TPC-H: <b>Total hot run time: 40035 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a73ffccfd7f218ce793e2d421514c08f84923707, data reload: false
------ Round 1 ----------------------------------
q1 17858 4477 4427 4427
q2 2591 198 200 198
q3 11793 1105 1148 1105
q4 10593 814 802 802
q5 7532 2715 2763 2715
q6 238 140 142 140
q7 982 640 629 629
q8 9527 2080 2039 2039
q9 8852 6430 6487 6430
q10 8997 3712 3708 3708
q11 451 242 230 230
q12 439 240 221 221
q13 17779 2980 2970 2970
q14 275 230 220 220
q15 514 481 475 475
q16 532 380 377 377
q17 974 752 647 647
q18 8109 7401 7353 7353
q19 7126 1438 1460 1438
q20 694 314 337 314
q21 4985 3269 3875 3269
q22 387 330 328 328
Total cold run time: 121228 ms
Total hot run time: 40035 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4390 4208 4218 4208
q2 379 269 263 263
q3 2990 2689 2722 2689
q4 1886 1626 1619 1619
q5 5253 5282 5274 5274
q6 213 125 131 125
q7 2160 1760 1771 1760
q8 3183 3303 3312 3303
q9 8350 8331 8356 8331
q10 3886 3652 3612 3612
q11 588 489 477 477
q12 766 585 611 585
q13 17346 2970 2973 2970
q14 279 264 250 250
q15 503 470 476 470
q16 479 426 412 412
q17 1757 1468 1475 1468
q18 7602 7575 7336 7336
q19 1685 1526 1588 1526
q20 1983 1767 1749 1749
q21 4881 4745 4633 4633
q22 587 504 534 504
Total cold run time: 71146 ms
Total hot run time: 53564 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2203211308
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2186325694
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2186051263
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2180564309
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put old partitions into recyclebin when replace partition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2172597706
<details>
<summary>TPC-H: <b>Total hot run time: 39566 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 862df4fa7f2afbf07ff971cbc3bea728c665b117, data reload: false
------ Round 1 ----------------------------------
q1 17616 4293 4271 4271
q2 2034 194 200 194
q3 10455 1144 1154 1144
q4 10199 778 795 778
q5 7456 2614 2615 2614
q6 219 137 136 136
q7 970 607 597 597
q8 9233 2044 2049 2044
q9 9022 6447 6448 6447
q10 8943 3750 3701 3701
q11 467 240 248 240
q12 475 243 229 229
q13 17779 2962 2965 2962
q14 275 226 233 226
q15 498 485 470 470
q16 523 379 383 379
q17 947 665 662 662
q18 7959 7417 7284 7284
q19 6507 1469 1427 1427
q20 664 321 324 321
q21 4965 3292 3100 3100
q22 390 345 340 340
Total cold run time: 117596 ms
Total hot run time: 39566 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4432 4213 4362 4213
q2 363 274 285 274
q3 2955 2869 2945 2869
q4 1951 1731 1689 1689
q5 5639 5516 5486 5486
q6 213 131 133 131
q7 2227 1937 1836 1836
q8 3257 3402 3419 3402
q9 8721 8653 8807 8653
q10 4065 3898 3739 3739
q11 574 509 511 509
q12 813 632 629 629
q13 15918 3206 3150 3150
q14 311 281 273 273
q15 532 484 493 484
q16 499 438 423 423
q17 1799 1496 1498 1496
q18 7986 7947 7757 7757
q19 1782 1527 1597 1527
q20 3026 1924 1895 1895
q21 9225 4970 4879 4879
q22 638 545 567 545
Total cold run time: 76926 ms
Total hot run time: 55859 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) Recycle partition when replace partition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2171774567
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put old partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2174095834
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2203327003
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2186379308
<details>
<summary>TPC-DS: <b>Total hot run time: 174859 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 95c5746775d2d0418010cd660a2655007dea7a98, data reload: false
query1 947 402 387 387
query2 6308 2560 2426 2426
query3 6629 200 197 197
query4 19123 17201 17296 17201
query5 3651 480 495 480
query6 271 161 156 156
query7 4588 295 300 295
query8 321 292 295 292
query9 8435 2471 2453 2453
query10 547 310 273 273
query11 10490 9953 9944 9944
query12 134 78 78 78
query13 1641 372 391 372
query14 9424 7600 7851 7600
query15 234 194 194 194
query16 7600 277 284 277
query17 1885 564 531 531
query18 1982 283 285 283
query19 197 158 179 158
query20 91 90 86 86
query21 208 125 122 122
query22 4365 4070 4033 4033
query23 33869 33752 33642 33642
query24 10993 2901 2827 2827
query25 644 417 413 413
query26 1549 166 163 163
query27 2930 331 333 331
query28 7595 2190 2176 2176
query29 984 656 667 656
query30 277 155 156 155
query31 931 770 785 770
query32 96 57 57 57
query33 777 315 320 315
query34 1004 488 506 488
query35 761 636 677 636
query36 1129 990 963 963
query37 159 75 76 75
query38 2953 2835 2794 2794
query39 922 837 854 837
query40 257 133 131 131
query41 58 52 54 52
query42 123 98 102 98
query43 582 572 560 560
query44 1176 734 733 733
query45 190 158 162 158
query46 1068 744 765 744
query47 1867 1762 1780 1762
query48 390 312 306 306
query49 999 434 440 434
query50 772 423 397 397
query51 6887 6831 6764 6764
query52 102 99 92 92
query53 357 295 298 295
query54 961 466 454 454
query55 77 75 74 74
query56 299 286 389 286
query57 1142 1053 1029 1029
query58 271 252 244 244
query59 3403 3246 3064 3064
query60 287 268 272 268
query61 108 90 88 88
query62 629 433 447 433
query63 320 293 293 293
query64 9723 2269 1752 1752
query65 3191 3081 3100 3081
query66 1216 345 329 329
query67 15632 15093 14793 14793
query68 8329 550 552 550
query69 727 469 445 445
query70 1219 1192 1150 1150
query71 559 277 276 276
query72 9043 5375 5441 5375
query73 976 330 330 330
query74 6148 5494 5392 5392
query75 5209 2678 2669 2669
query76 4861 975 910 910
query77 773 311 302 302
query78 10401 9987 9852 9852
query79 7768 523 520 520
query80 957 493 477 477
query81 549 259 224 224
query82 624 105 105 105
query83 351 176 170 170
query84 271 86 89 86
query85 1270 284 266 266
query86 373 310 307 307
query87 3248 3077 3065 3065
query88 4395 2467 2445 2445
query89 532 382 382 382
query90 1991 195 189 189
query91 133 101 101 101
query92 59 50 47 47
query93 6362 522 521 521
query94 1120 195 193 193
query95 414 321 318 318
query96 618 271 273 271
query97 3188 3037 3074 3037
query98 221 199 188 188
query99 1187 876 846 846
Total cold run time: 292607 ms
Total hot run time: 174859 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put old partitions into recyclebin when replace partition [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2172675040
<details>
<summary>ClickBench: <b>Total hot run time: 30.35 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 862df4fa7f2afbf07ff971cbc3bea728c665b117, data reload: false
query1 0.04 0.04 0.03
query2 0.09 0.04 0.05
query3 0.22 0.05 0.04
query4 1.69 0.07 0.07
query5 0.50 0.49 0.50
query6 1.13 0.72 0.72
query7 0.02 0.01 0.02
query8 0.04 0.04 0.04
query9 0.54 0.49 0.50
query10 0.54 0.56 0.53
query11 0.16 0.11 0.11
query12 0.14 0.12 0.13
query13 0.60 0.60 0.61
query14 0.77 0.77 0.78
query15 0.82 0.81 0.81
query16 0.36 0.36 0.35
query17 0.97 1.01 1.00
query18 0.21 0.27 0.24
query19 1.76 1.69 1.71
query20 0.01 0.01 0.02
query21 15.52 0.66 0.65
query22 3.98 7.88 1.76
query23 18.33 1.36 1.24
query24 2.15 0.21 0.21
query25 0.16 0.07 0.07
query26 0.27 0.17 0.18
query27 0.08 0.09 0.07
query28 13.27 1.02 1.01
query29 12.66 3.29 3.24
query30 0.27 0.06 0.06
query31 2.87 0.40 0.39
query32 3.27 0.46 0.47
query33 2.89 2.88 2.84
query34 17.04 4.46 4.49
query35 4.49 4.51 4.50
query36 0.64 0.49 0.46
query37 0.18 0.16 0.17
query38 0.15 0.14 0.14
query39 0.04 0.03 0.04
query40 0.17 0.15 0.14
query41 0.09 0.05 0.05
query42 0.05 0.05 0.04
query43 0.04 0.04 0.04
Total cold run time: 109.22 s
Total hot run time: 30.35 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "liutang123 (via GitHub)" <gi...@apache.org>.
liutang123 commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2185093030
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2205009404
<details>
<summary>TPC-H: <b>Total hot run time: 39766 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 35210d8492e7e5e528c8d4346dde19d270998514, data reload: false
------ Round 1 ----------------------------------
q1 17633 4270 4262 4262
q2 2006 192 183 183
q3 10477 1222 1117 1117
q4 10184 806 945 806
q5 7537 2655 2616 2616
q6 219 133 133 133
q7 941 600 614 600
q8 9224 2066 2051 2051
q9 8707 6481 6383 6383
q10 8993 3673 3728 3673
q11 479 233 234 233
q12 413 234 236 234
q13 17773 3027 2978 2978
q14 257 230 217 217
q15 530 489 473 473
q16 509 388 377 377
q17 950 596 722 596
q18 8050 7414 7416 7414
q19 6899 1533 1497 1497
q20 656 325 320 320
q21 4825 3824 3261 3261
q22 404 342 346 342
Total cold run time: 117666 ms
Total hot run time: 39766 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4508 4223 4768 4223
q2 372 265 259 259
q3 3006 2929 2948 2929
q4 2018 1687 1738 1687
q5 5562 5458 5431 5431
q6 221 136 140 136
q7 2220 1902 1805 1805
q8 3240 3434 3422 3422
q9 8713 8794 8860 8794
q10 4160 3900 3838 3838
q11 613 508 517 508
q12 813 650 661 650
q13 17113 3218 3259 3218
q14 312 302 274 274
q15 542 499 490 490
q16 510 454 425 425
q17 1820 1533 1511 1511
q18 8159 8055 7837 7837
q19 1883 1802 1542 1542
q20 2102 1940 1870 1870
q21 5259 4868 5098 4868
q22 663 577 623 577
Total cold run time: 73809 ms
Total hot run time: 56294 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2186389279
<details>
<summary>ClickBench: <b>Total hot run time: 30.5 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 95c5746775d2d0418010cd660a2655007dea7a98, data reload: false
query1 0.04 0.04 0.03
query2 0.08 0.04 0.05
query3 0.22 0.06 0.05
query4 1.68 0.07 0.08
query5 0.51 0.48 0.49
query6 1.14 0.71 0.72
query7 0.02 0.01 0.02
query8 0.05 0.05 0.04
query9 0.54 0.50 0.50
query10 0.56 0.54 0.55
query11 0.15 0.11 0.10
query12 0.15 0.12 0.12
query13 0.58 0.58 0.59
query14 0.76 0.77 0.79
query15 0.82 0.81 0.80
query16 0.38 0.36 0.36
query17 1.01 1.04 1.03
query18 0.22 0.24 0.24
query19 1.90 1.73 1.71
query20 0.02 0.01 0.02
query21 15.44 0.66 0.65
query22 4.34 7.12 1.89
query23 18.25 1.30 1.22
query24 2.07 0.22 0.23
query25 0.15 0.09 0.08
query26 0.27 0.18 0.17
query27 0.08 0.08 0.08
query28 13.22 1.02 1.00
query29 12.61 3.28 3.28
query30 0.25 0.06 0.05
query31 2.91 0.39 0.39
query32 3.24 0.48 0.47
query33 2.90 2.93 2.89
query34 17.01 4.44 4.40
query35 4.53 4.49 4.54
query36 0.65 0.49 0.46
query37 0.18 0.15 0.16
query38 0.16 0.14 0.14
query39 0.05 0.03 0.03
query40 0.17 0.15 0.13
query41 0.10 0.04 0.04
query42 0.05 0.04 0.05
query43 0.04 0.05 0.04
Total cold run time: 109.5 s
Total hot run time: 30.5 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2186563560
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](meta) put normal partitions into recyclebin when replacing partitions [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #36361:
URL: https://github.com/apache/doris/pull/36361#issuecomment-2186357367
<details>
<summary>TPC-H: <b>Total hot run time: 39890 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 95c5746775d2d0418010cd660a2655007dea7a98, data reload: false
------ Round 1 ----------------------------------
q1 17630 4301 4233 4233
q2 2007 189 188 188
q3 10759 1156 1191 1156
q4 11417 884 774 774
q5 7566 2660 2635 2635
q6 226 138 137 137
q7 949 606 618 606
q8 9496 2094 2082 2082
q9 9166 6573 6523 6523
q10 8983 3708 3779 3708
q11 502 250 248 248
q12 494 231 233 231
q13 17769 2991 2987 2987
q14 271 218 218 218
q15 513 489 502 489
q16 513 378 377 377
q17 953 689 725 689
q18 8033 7484 7367 7367
q19 3960 1474 1419 1419
q20 666 331 340 331
q21 4895 3147 3976 3147
q22 411 345 345 345
Total cold run time: 117179 ms
Total hot run time: 39890 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4389 4179 4189 4179
q2 372 270 265 265
q3 2975 2898 2899 2898
q4 1972 1755 1719 1719
q5 5493 5492 5467 5467
q6 225 139 133 133
q7 2187 1901 1908 1901
q8 3305 3404 3679 3404
q9 8697 8498 8697 8498
q10 4044 3819 3763 3763
q11 609 495 491 491
q12 811 638 648 638
q13 17681 3219 3176 3176
q14 304 271 278 271
q15 525 484 484 484
q16 509 430 450 430
q17 1820 1546 1525 1525
q18 8134 7874 7771 7771
q19 1761 1607 1664 1607
q20 2042 1808 1775 1775
q21 5100 4940 4936 4936
q22 677 578 577 577
Total cold run time: 73632 ms
Total hot run time: 55908 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org