You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "JackDrogon (via GitHub)" <gi...@apache.org> on 2024/02/02 11:23:13 UTC
[PR] [feature](binlog) Add show proc '/binlog' impl [doris]
JackDrogon opened a new pull request, #30770:
URL: https://github.com/apache/doris/pull/30770
## Proposed changes
Add show proc '/binlog' impl
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923650991
<details>
<summary>TPC-H: <b>Total hot run time: 36805 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 545dd6adcfa2f9fba5b633c2843241f77e27308b, data reload: false
------ Round 1 ----------------------------------
q1 17692 4498 4423 4423
q2 2042 148 133 133
q3 10597 903 941 903
q4 4645 741 684 684
q5 7717 2803 2718 2718
q6 180 118 117 117
q7 1130 721 718 718
q8 9301 1965 1993 1965
q9 7240 6325 6338 6325
q10 8104 2404 2430 2404
q11 429 207 218 207
q12 758 275 290 275
q13 18020 3322 3363 3322
q14 287 243 242 242
q15 526 489 489 489
q16 521 411 405 405
q17 933 513 521 513
q18 6806 5902 5885 5885
q19 1571 1374 1395 1374
q20 573 336 320 320
q21 6751 3090 3080 3080
q22 815 303 305 303
Total cold run time: 106638 ms
Total hot run time: 36805 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4408 4360 4462 4360
q2 332 231 237 231
q3 2964 2825 2829 2825
q4 1868 1630 1666 1630
q5 5190 5250 5219 5219
q6 198 113 115 113
q7 2186 1720 1724 1720
q8 3101 3202 3236 3202
q9 8365 8293 8277 8277
q10 5815 3542 3554 3542
q11 551 470 461 461
q12 759 599 584 584
q13 15916 3104 3071 3071
q14 294 244 274 244
q15 534 503 489 489
q16 489 468 459 459
q17 1834 1686 1686 1686
q18 8071 7590 7570 7570
q19 9189 1533 1532 1532
q20 2168 1914 1908 1908
q21 4879 4634 4656 4634
q22 528 461 451 451
Total cold run time: 79639 ms
Total hot run time: 54208 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923607620
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923675962
<details>
<summary>ClickBench: <b>Total hot run time: 31.09 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 545dd6adcfa2f9fba5b633c2843241f77e27308b, data reload: false
query1 0.04 0.04 0.03
query2 0.06 0.03 0.03
query3 0.23 0.06 0.06
query4 1.67 0.10 0.10
query5 0.52 0.52 0.51
query6 1.18 0.64 0.67
query7 0.01 0.01 0.01
query8 0.04 0.02 0.02
query9 0.56 0.50 0.51
query10 0.56 0.57 0.57
query11 0.12 0.08 0.08
query12 0.11 0.09 0.09
query13 0.60 0.60 0.61
query14 0.79 0.81 0.80
query15 0.80 0.79 0.76
query16 0.36 0.39 0.39
query17 0.98 1.01 1.05
query18 0.22 0.25 0.25
query19 1.93 1.77 1.68
query20 0.01 0.02 0.01
query21 15.40 0.58 0.58
query22 2.87 1.79 2.37
query23 17.14 0.84 0.79
query24 3.23 1.29 1.15
query25 0.26 0.20 0.21
query26 0.57 0.13 0.15
query27 0.07 0.05 0.04
query28 10.38 0.83 0.83
query29 12.52 3.08 3.20
query30 0.63 0.56 0.55
query31 2.78 0.34 0.35
query32 3.35 0.47 0.49
query33 3.23 3.20 3.23
query34 15.78 4.30 4.27
query35 4.28 4.23 4.32
query36 1.13 1.04 1.05
query37 0.06 0.05 0.06
query38 0.03 0.02 0.02
query39 0.02 0.01 0.01
query40 0.17 0.14 0.16
query41 0.08 0.01 0.01
query42 0.02 0.01 0.02
query43 0.03 0.02 0.02
Total cold run time: 104.82 s
Total hot run time: 31.09 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923680365
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 545dd6adcfa2f9fba5b633c2843241f77e27308b with default session variables
Stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.7 seconds inserted 10000000 Rows, about 729K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923820633
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #30770:
URL: https://github.com/apache/doris/pull/30770
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "JackDrogon (via GitHub)" <gi...@apache.org>.
JackDrogon commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923607727
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923623627
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [feature](binlog) Add show proc '/binlog' impl [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #30770:
URL: https://github.com/apache/doris/pull/30770#issuecomment-1923668039
<details>
<summary>TPC-DS: <b>Total hot run time: 174929 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 545dd6adcfa2f9fba5b633c2843241f77e27308b, data reload: false
query1 921 341 328 328
query2 6560 1897 1974 1897
query3 6700 199 199 199
query4 31570 21998 22081 21998
query5 4268 428 362 362
query6 262 174 163 163
query7 4600 282 275 275
query8 245 174 176 174
query9 9342 2298 2295 2295
query10 424 215 212 212
query11 18071 15425 15543 15425
query12 133 76 74 74
query13 1636 406 409 406
query14 9357 7106 7242 7106
query15 254 184 183 183
query16 8148 269 244 244
query17 2067 532 496 496
query18 2103 264 261 261
query19 355 145 142 142
query20 86 76 78 76
query21 197 128 119 119
query22 4963 4766 4843 4766
query23 31768 29914 30018 29914
query24 10448 2784 2787 2784
query25 537 351 334 334
query26 710 146 146 146
query27 2188 301 303 301
query28 5747 1845 1826 1826
query29 914 627 618 618
query30 273 132 144 132
query31 932 702 696 696
query32 91 58 56 56
query33 617 231 219 219
query34 842 455 478 455
query35 862 773 746 746
query36 1072 902 926 902
query37 100 57 58 57
query38 3238 3144 3117 3117
query39 1307 1243 1253 1243
query40 180 94 91 91
query41 40 35 34 34
query42 97 87 91 87
query43 509 462 491 462
query44 1089 688 700 688
query45 195 182 175 175
query46 1033 653 659 653
query47 1519 1498 1421 1421
query48 417 358 350 350
query49 1043 292 288 288
query50 755 372 389 372
query51 5301 5181 5126 5126
query52 103 86 84 84
query53 334 271 264 264
query54 283 223 222 222
query55 82 73 71 71
query56 221 200 191 191
query57 922 930 892 892
query58 198 181 181 181
query59 2470 2268 2243 2243
query60 232 224 211 211
query61 86 84 83 83
query62 639 369 375 369
query63 298 271 291 271
query64 4989 3601 3554 3554
query65 3236 3274 3242 3242
query66 828 317 305 305
query67 14418 14141 14217 14141
query68 4456 535 521 521
query69 456 328 326 326
query70 1206 1231 1233 1231
query71 328 245 245 245
query72 6141 2865 2689 2689
query73 694 316 321 316
query74 6604 6239 6178 6178
query75 3021 2417 2369 2369
query76 2624 970 996 970
query77 366 227 222 222
query78 9133 8745 8698 8698
query79 2657 486 479 479
query80 2126 351 339 339
query81 549 194 200 194
query82 808 81 82 81
query83 246 123 125 123
query84 285 82 77 77
query85 2223 333 334 333
query86 484 270 300 270
query87 3386 3218 3192 3192
query88 3741 2331 2324 2324
query89 460 359 352 352
query90 2047 161 165 161
query91 151 138 120 120
query92 57 40 41 40
query93 2798 507 480 480
query94 1542 184 173 173
query95 8134 7796 364 364
query96 595 268 268 268
query97 4237 4107 4125 4107
query98 226 203 195 195
query99 1132 741 674 674
Total cold run time: 288338 ms
Total hot run time: 174929 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org