You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "wangshuo128 (via GitHub)" <gi...@apache.org> on 2024/07/03 06:55:31 UTC
[PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
wangshuo128 opened a new pull request, #37204:
URL: https://github.com/apache/doris/pull/37204
## Proposed changes
This PR proposed to reduce the number of RPC from FE to meta service for next txn ID when register watershed txn ID.
Issue Number: close #xxx
<!--Describe your changes.-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2207974196
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208882562
<details>
<summary>TPC-H: <b>Total hot run time: 40217 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 435e5939e178b0e8ccaa4793d36e26ef9d5202d8, data reload: false
------ Round 1 ----------------------------------
q1 17611 4346 4268 4268
q2 2022 188 183 183
q3 10477 1167 1055 1055
q4 10194 757 754 754
q5 7515 2651 2633 2633
q6 223 134 136 134
q7 945 606 615 606
q8 9230 2080 2072 2072
q9 9042 6510 6437 6437
q10 8950 3752 3685 3685
q11 463 234 230 230
q12 470 241 243 241
q13 18678 2956 2956 2956
q14 286 220 207 207
q15 527 487 486 486
q16 514 385 376 376
q17 970 613 650 613
q18 7902 7502 7409 7409
q19 5004 1478 1514 1478
q20 659 316 319 316
q21 5008 3739 3947 3739
q22 402 347 339 339
Total cold run time: 117092 ms
Total hot run time: 40217 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4368 4232 4223 4223
q2 357 274 264 264
q3 2969 2888 2850 2850
q4 2010 1705 1721 1705
q5 5603 5495 5421 5421
q6 230 130 131 130
q7 2196 1836 1860 1836
q8 3285 3397 3440 3397
q9 8668 8708 8799 8708
q10 4070 3853 3717 3717
q11 591 506 501 501
q12 842 669 669 669
q13 17049 3184 3139 3139
q14 309 274 279 274
q15 521 498 485 485
q16 495 430 426 426
q17 1825 1533 1495 1495
q18 8093 7951 7802 7802
q19 1849 1607 1729 1607
q20 2220 1881 1859 1859
q21 5193 4914 4791 4791
q22 634 574 561 561
Total cold run time: 73377 ms
Total hot run time: 55860 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2212915148
<details>
<summary>TPC-DS: <b>Total hot run time: 173496 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 435e5939e178b0e8ccaa4793d36e26ef9d5202d8, data reload: false
query1 913 373 371 371
query2 6457 2471 2512 2471
query3 6649 206 215 206
query4 28495 17526 17493 17493
query5 4192 501 492 492
query6 259 174 164 164
query7 4599 307 297 297
query8 324 292 294 292
query9 8458 2373 2360 2360
query10 610 319 297 297
query11 12773 10013 10107 10013
query12 129 86 84 84
query13 1657 388 392 388
query14 10705 7749 7720 7720
query15 284 190 191 190
query16 8010 316 318 316
query17 1813 560 541 541
query18 1858 286 285 285
query19 190 157 158 157
query20 95 84 83 83
query21 216 129 138 129
query22 4446 3991 3988 3988
query23 33770 32995 33100 32995
query24 11029 2952 2852 2852
query25 610 381 395 381
query26 1265 158 156 156
query27 2843 314 316 314
query28 7492 2065 2064 2064
query29 885 655 631 631
query30 282 152 157 152
query31 987 728 756 728
query32 97 54 61 54
query33 795 344 313 313
query34 919 484 485 484
query35 754 684 634 634
query36 1115 914 914 914
query37 135 83 78 78
query38 2841 2737 2709 2709
query39 884 817 827 817
query40 287 136 127 127
query41 57 48 48 48
query42 117 97 103 97
query43 612 595 581 581
query44 1262 754 750 750
query45 191 162 160 160
query46 1080 738 751 738
query47 1824 1752 1765 1752
query48 379 310 314 310
query49 1106 451 429 429
query50 776 408 401 401
query51 7028 6790 6738 6738
query52 106 91 94 91
query53 371 297 299 297
query54 1037 480 462 462
query55 76 74 76 74
query56 310 286 302 286
query57 1150 1050 1036 1036
query58 378 242 254 242
query59 3508 3234 3221 3221
query60 300 283 281 281
query61 93 95 105 95
query62 651 454 448 448
query63 333 291 290 290
query64 10667 2171 1620 1620
query65 3188 3107 3121 3107
query66 1192 340 358 340
query67 15905 14844 14744 14744
query68 9160 550 560 550
query69 763 512 372 372
query70 1315 1052 1136 1052
query71 539 286 275 275
query72 8942 5677 5834 5677
query73 2256 325 329 325
query74 5956 5525 5430 5430
query75 5399 2654 2708 2654
query76 5412 948 955 948
query77 744 310 302 302
query78 9665 8922 8780 8780
query79 9974 528 520 520
query80 1124 484 479 479
query81 577 230 219 219
query82 253 102 104 102
query83 290 165 160 160
query84 272 85 85 85
query85 1019 315 290 290
query86 351 331 314 314
query87 3349 3071 3121 3071
query88 4846 2445 2459 2445
query89 528 383 378 378
query90 2050 185 192 185
query91 130 101 102 101
query92 60 50 51 50
query93 6478 504 512 504
query94 1436 222 211 211
query95 409 312 326 312
query96 609 277 267 267
query97 3165 3024 3048 3024
query98 230 205 193 193
query99 1112 843 848 843
Total cold run time: 312232 ms
Total hot run time: 173496 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208293305
<details>
<summary>ClickBench: <b>Total hot run time: 30.97 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1c48102ef642c9f17ec33014f9280c84fe82b157, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.04 0.04
query3 0.22 0.05 0.05
query4 1.66 0.09 0.09
query5 0.50 0.48 0.48
query6 1.15 0.73 0.73
query7 0.02 0.02 0.01
query8 0.05 0.04 0.04
query9 0.55 0.50 0.49
query10 0.55 0.55 0.55
query11 0.15 0.11 0.12
query12 0.16 0.12 0.13
query13 0.61 0.59 0.59
query14 0.80 0.79 0.80
query15 0.82 0.83 0.82
query16 0.37 0.37 0.36
query17 1.02 0.99 1.00
query18 0.22 0.24 0.25
query19 1.87 1.82 1.69
query20 0.01 0.02 0.01
query21 15.41 0.76 0.66
query22 4.06 6.93 2.16
query23 18.31 1.37 1.26
query24 2.18 0.24 0.23
query25 0.17 0.09 0.08
query26 0.27 0.18 0.18
query27 0.09 0.09 0.08
query28 13.18 1.01 1.01
query29 12.60 3.30 3.29
query30 0.25 0.06 0.05
query31 2.87 0.39 0.39
query32 3.27 0.49 0.48
query33 2.90 2.94 2.86
query34 17.23 4.43 4.41
query35 4.51 4.54 4.51
query36 0.66 0.47 0.47
query37 0.19 0.16 0.16
query38 0.17 0.16 0.15
query39 0.04 0.03 0.04
query40 0.16 0.15 0.15
query41 0.10 0.05 0.05
query42 0.06 0.04 0.04
query43 0.04 0.04 0.04
Total cold run time: 109.57 s
Total hot run time: 30.97 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2212900800
<details>
<summary>TPC-H: <b>Total hot run time: 40388 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 435e5939e178b0e8ccaa4793d36e26ef9d5202d8, data reload: false
------ Round 1 ----------------------------------
q1 17836 4486 4403 4403
q2 2579 199 196 196
q3 12310 1168 1133 1133
q4 10801 787 818 787
q5 7567 2716 2667 2667
q6 226 143 144 143
q7 957 599 608 599
q8 9224 2073 2085 2073
q9 8990 6539 6473 6473
q10 8827 3742 3783 3742
q11 468 245 270 245
q12 402 248 235 235
q13 18853 3012 3015 3012
q14 267 225 219 219
q15 540 498 506 498
q16 503 383 382 382
q17 967 656 676 656
q18 8087 7449 7371 7371
q19 7561 1518 1522 1518
q20 670 327 324 324
q21 5081 4017 3373 3373
q22 425 355 339 339
Total cold run time: 123141 ms
Total hot run time: 40388 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4426 4270 4258 4258
q2 373 256 274 256
q3 3015 2794 2723 2723
q4 1877 1607 1585 1585
q5 5271 5288 5291 5288
q6 220 131 133 131
q7 2135 1777 1701 1701
q8 3197 3365 3321 3321
q9 8336 8359 8338 8338
q10 3841 3702 3669 3669
q11 594 508 488 488
q12 779 593 590 590
q13 17517 3017 2994 2994
q14 301 286 263 263
q15 516 485 478 478
q16 468 420 432 420
q17 1801 1483 1488 1483
q18 7610 7645 7544 7544
q19 1696 1640 1572 1572
q20 1953 1778 1776 1776
q21 4896 4852 4928 4852
q22 648 536 564 536
Total cold run time: 71470 ms
Total hot run time: 54266 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2207974075
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208267419
<details>
<summary>TPC-H: <b>Total hot run time: 40089 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1c48102ef642c9f17ec33014f9280c84fe82b157, data reload: false
------ Round 1 ----------------------------------
q1 18072 5399 4430 4430
q2 2567 198 194 194
q3 12113 1179 1057 1057
q4 10849 808 812 808
q5 7882 2704 2661 2661
q6 225 140 142 140
q7 961 600 606 600
q8 9221 2049 2079 2049
q9 8916 6475 6437 6437
q10 8956 3720 3734 3720
q11 467 241 242 241
q12 423 242 228 228
q13 17886 2996 2984 2984
q14 257 240 219 219
q15 525 484 483 483
q16 509 377 390 377
q17 963 671 690 671
q18 8082 7417 7468 7417
q19 2228 1575 1578 1575
q20 672 340 330 330
q21 4997 3127 3893 3127
q22 406 343 341 341
Total cold run time: 117177 ms
Total hot run time: 40089 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4422 4309 4247 4247
q2 368 269 260 260
q3 3023 2723 2777 2723
q4 1867 1647 1635 1635
q5 5271 5265 5288 5265
q6 221 129 132 129
q7 2109 1755 1686 1686
q8 3182 3323 3310 3310
q9 8348 8326 8337 8326
q10 3871 3702 3605 3605
q11 604 495 508 495
q12 788 624 607 607
q13 16996 2991 3024 2991
q14 305 265 254 254
q15 521 487 482 482
q16 457 403 417 403
q17 1755 1587 1458 1458
q18 7708 7441 7302 7302
q19 4747 1618 1561 1561
q20 1997 1786 1756 1756
q21 4827 4790 4680 4680
q22 638 518 543 518
Total cold run time: 74025 ms
Total hot run time: 53693 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "w41ter (via GitHub)" <gi...@apache.org>.
w41ter merged PR #37204:
URL: https://github.com/apache/doris/pull/37204
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "wangshuo128 (via GitHub)" <gi...@apache.org>.
wangshuo128 commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208228608
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208906481
<details>
<summary>TPC-DS: <b>Total hot run time: 173763 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 435e5939e178b0e8ccaa4793d36e26ef9d5202d8, data reload: false
query1 930 381 379 379
query2 6447 2360 2230 2230
query3 6633 204 209 204
query4 19962 17503 17451 17451
query5 3731 474 475 474
query6 264 167 159 159
query7 4587 286 285 285
query8 309 297 278 278
query9 8485 2411 2397 2397
query10 565 302 282 282
query11 10479 10048 10048 10048
query12 116 85 83 83
query13 1651 372 354 354
query14 9356 7822 7617 7617
query15 234 189 189 189
query16 7780 321 311 311
query17 1802 566 539 539
query18 1818 277 280 277
query19 210 157 159 157
query20 91 85 82 82
query21 218 133 127 127
query22 4371 4213 4038 4038
query23 34020 33616 33825 33616
query24 11044 2915 2928 2915
query25 640 401 399 399
query26 720 161 159 159
query27 2322 327 327 327
query28 6195 2139 2154 2139
query29 901 688 659 659
query30 254 165 169 165
query31 953 769 752 752
query32 96 54 55 54
query33 784 311 296 296
query34 1043 493 486 486
query35 781 663 645 645
query36 1140 1001 976 976
query37 140 80 83 80
query38 3102 2841 2798 2798
query39 916 833 834 833
query40 201 128 121 121
query41 50 49 54 49
query42 117 104 96 96
query43 597 532 541 532
query44 1182 733 721 721
query45 195 161 160 160
query46 1075 734 727 727
query47 1876 1769 1788 1769
query48 365 296 296 296
query49 823 393 401 393
query50 753 377 377 377
query51 6847 6713 6821 6713
query52 96 93 89 89
query53 358 283 281 281
query54 933 441 443 441
query55 75 71 70 70
query56 283 274 278 274
query57 1125 1035 1039 1035
query58 249 251 250 250
query59 3508 3313 3163 3163
query60 303 275 277 275
query61 97 90 93 90
query62 605 448 443 443
query63 320 285 292 285
query64 8560 2242 1784 1784
query65 3165 3090 3097 3090
query66 743 318 331 318
query67 15771 15055 14911 14911
query68 7432 529 539 529
query69 755 419 347 347
query70 1200 1031 1109 1031
query71 520 282 280 280
query72 8469 5198 5309 5198
query73 802 324 322 322
query74 5921 5598 5448 5448
query75 5368 2665 2640 2640
query76 4992 962 883 883
query77 770 283 297 283
query78 10396 10388 9241 9241
query79 9524 520 507 507
query80 864 473 470 470
query81 543 214 224 214
query82 458 103 102 102
query83 333 166 160 160
query84 271 85 87 85
query85 755 328 265 265
query86 443 298 300 298
query87 3327 3092 3057 3057
query88 4851 2364 2357 2357
query89 493 381 391 381
query90 2028 187 186 186
query91 128 100 98 98
query92 59 48 47 47
query93 3672 495 495 495
query94 1221 204 208 204
query95 404 315 312 312
query96 608 270 276 270
query97 3200 3012 3001 3001
query98 216 197 195 195
query99 1158 855 844 844
Total cold run time: 286543 ms
Total hot run time: 173763 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "wangshuo128 (via GitHub)" <gi...@apache.org>.
wangshuo128 commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2210524287
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "wangshuo128 (via GitHub)" <gi...@apache.org>.
wangshuo128 commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2216099520
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208284182
<details>
<summary>TPC-DS: <b>Total hot run time: 172744 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1c48102ef642c9f17ec33014f9280c84fe82b157, data reload: false
query1 938 377 367 367
query2 6472 2534 2313 2313
query3 6669 206 208 206
query4 20578 17464 17492 17464
query5 4184 504 499 499
query6 286 170 176 170
query7 4603 300 300 300
query8 322 305 295 295
query9 8562 2458 2434 2434
query10 602 302 299 299
query11 10413 10005 10047 10005
query12 137 85 86 85
query13 1654 375 410 375
query14 10226 7598 7212 7212
query15 236 192 194 192
query16 7914 324 314 314
query17 1803 584 515 515
query18 1997 276 267 267
query19 197 145 150 145
query20 88 81 82 81
query21 215 145 126 126
query22 4374 3996 4001 3996
query23 33705 33073 33081 33073
query24 11870 2835 2838 2835
query25 658 360 361 360
query26 1755 156 151 151
query27 2963 311 316 311
query28 7267 2100 2085 2085
query29 1040 653 607 607
query30 267 149 155 149
query31 936 724 725 724
query32 93 52 54 52
query33 768 293 282 282
query34 955 455 476 455
query35 748 639 604 604
query36 1092 975 916 916
query37 194 82 76 76
query38 2879 2739 2794 2739
query39 840 828 801 801
query40 281 131 127 127
query41 57 52 51 51
query42 123 102 104 102
query43 595 542 568 542
query44 1171 738 740 738
query45 205 164 163 163
query46 1069 753 741 741
query47 1879 1785 1800 1785
query48 366 293 301 293
query49 1243 426 411 411
query50 763 380 393 380
query51 6837 6844 6859 6844
query52 108 95 91 91
query53 363 291 292 291
query54 939 458 453 453
query55 79 75 75 75
query56 293 264 273 264
query57 1210 1052 1082 1052
query58 265 259 252 252
query59 3397 3165 3356 3165
query60 298 275 275 275
query61 95 92 97 92
query62 655 450 446 446
query63 332 291 290 290
query64 9846 2259 1757 1757
query65 3150 3158 3104 3104
query66 1386 333 329 329
query67 15567 14922 14924 14922
query68 4615 570 558 558
query69 466 310 311 310
query70 1162 1150 1168 1150
query71 402 276 287 276
query72 7287 5353 5579 5353
query73 736 328 326 326
query74 5897 5465 5552 5465
query75 3423 2685 2651 2651
query76 2528 942 945 942
query77 454 308 307 307
query78 9426 9126 8813 8813
query79 2276 526 527 526
query80 1340 478 463 463
query81 579 219 223 219
query82 756 104 106 104
query83 244 167 165 165
query84 241 86 85 85
query85 2042 287 273 273
query86 497 310 333 310
query87 3264 3162 3111 3111
query88 3673 2372 2358 2358
query89 485 396 386 386
query90 1915 192 193 192
query91 129 99 103 99
query92 61 50 48 48
query93 2459 519 515 515
query94 1284 213 209 209
query95 401 312 315 312
query96 595 268 269 268
query97 3198 3018 2995 2995
query98 214 207 199 199
query99 1347 846 841 841
Total cold run time: 276468 ms
Total hot run time: 172744 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "wangshuo128 (via GitHub)" <gi...@apache.org>.
wangshuo128 commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208799911
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2205228500
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
Since 2024-03-18, the Document has been moved to [doris-website](https://github.com/apache/doris-website).
See [Doris Document](https://cwiki.apache.org/confluence/display/DORIS/Doris+Document).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2208925652
<details>
<summary>ClickBench: <b>Total hot run time: 30.28 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 435e5939e178b0e8ccaa4793d36e26ef9d5202d8, data reload: false
query1 0.04 0.03 0.03
query2 0.08 0.04 0.05
query3 0.23 0.05 0.06
query4 1.67 0.10 0.10
query5 0.51 0.49 0.48
query6 1.14 0.73 0.73
query7 0.02 0.01 0.01
query8 0.05 0.04 0.04
query9 0.55 0.51 0.49
query10 0.54 0.54 0.53
query11 0.16 0.12 0.12
query12 0.14 0.12 0.13
query13 0.58 0.58 0.58
query14 0.77 0.80 0.76
query15 0.85 0.82 0.80
query16 0.36 0.36 0.36
query17 1.00 1.06 0.97
query18 0.22 0.25 0.25
query19 1.80 1.66 1.66
query20 0.01 0.00 0.00
query21 15.41 0.77 0.66
query22 3.94 7.93 1.61
query23 18.34 1.43 1.28
query24 2.09 0.24 0.22
query25 0.15 0.09 0.09
query26 0.30 0.21 0.20
query27 0.46 0.24 0.23
query28 13.28 1.02 1.00
query29 12.63 3.29 3.30
query30 0.26 0.05 0.05
query31 2.86 0.39 0.38
query32 3.29 0.47 0.46
query33 2.88 2.95 2.90
query34 17.05 4.45 4.33
query35 4.40 4.48 4.41
query36 0.66 0.49 0.49
query37 0.19 0.15 0.15
query38 0.16 0.14 0.15
query39 0.04 0.03 0.04
query40 0.14 0.11 0.12
query41 0.10 0.05 0.05
query42 0.05 0.04 0.04
query43 0.04 0.04 0.04
Total cold run time: 109.44 s
Total hot run time: 30.28 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "wangshuo128 (via GitHub)" <gi...@apache.org>.
wangshuo128 commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2212871301
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [Improvement](Cloud) Avoid unnecessary RPC to meta service for watershed txn id. [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #37204:
URL: https://github.com/apache/doris/pull/37204#issuecomment-2212921032
<details>
<summary>ClickBench: <b>Total hot run time: 30.78 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 435e5939e178b0e8ccaa4793d36e26ef9d5202d8, data reload: false
query1 0.04 0.04 0.04
query2 0.08 0.04 0.04
query3 0.23 0.05 0.04
query4 1.69 0.08 0.08
query5 0.50 0.50 0.48
query6 1.13 0.72 0.72
query7 0.02 0.01 0.01
query8 0.05 0.05 0.05
query9 0.55 0.49 0.50
query10 0.55 0.56 0.54
query11 0.16 0.11 0.11
query12 0.14 0.12 0.12
query13 0.59 0.60 0.59
query14 0.76 0.76 0.78
query15 0.86 0.81 0.82
query16 0.36 0.36 0.38
query17 0.95 1.07 1.02
query18 0.23 0.25 0.24
query19 1.93 1.82 1.74
query20 0.02 0.01 0.01
query21 15.40 0.76 0.66
query22 3.76 7.76 1.96
query23 18.32 1.35 1.29
query24 2.07 0.22 0.23
query25 0.16 0.09 0.08
query26 0.28 0.21 0.20
query27 0.45 0.23 0.24
query28 13.31 1.00 1.00
query29 12.61 3.31 3.33
query30 0.26 0.05 0.05
query31 2.88 0.38 0.38
query32 3.27 0.48 0.47
query33 2.91 2.93 2.92
query34 16.94 4.44 4.33
query35 4.40 4.41 4.42
query36 0.66 0.47 0.50
query37 0.19 0.16 0.15
query38 0.15 0.14 0.14
query39 0.04 0.03 0.03
query40 0.14 0.12 0.11
query41 0.08 0.04 0.05
query42 0.06 0.04 0.05
query43 0.05 0.04 0.04
Total cold run time: 109.23 s
Total hot run time: 30.78 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org