You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org> on 2024/03/06 09:56:15 UTC
[PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
zhiqiang-hhhh opened a new pull request, #31867:
URL: https://github.com/apache/doris/pull/31867
pick #31809
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980491089
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980674614
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit f69d4a5b927139e00f7307d57e081ee577b17a20 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 20.5 seconds inserted 10000000 Rows, about 487K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980595304
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #31867:
URL: https://github.com/apache/doris/pull/31867
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "zhiqiang-hhhh (via GitHub)" <gi...@apache.org>.
zhiqiang-hhhh commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980569120
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980659636
<details>
<summary>TPC-DS: <b>Total hot run time: 201742 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f69d4a5b927139e00f7307d57e081ee577b17a20, data reload: false
query1 945 384 377 377
query2 6539 2272 2143 2143
query3 6914 211 205 205
query4 20252 17780 17834 17780
query5 19723 6584 6469 6469
query6 306 212 222 212
query7 4276 309 291 291
query8 265 257 232 232
query9 3120 2729 2619 2619
query10 412 293 302 293
query11 11300 10560 10650 10560
query12 121 81 72 72
query13 5572 643 619 619
query14 17867 13194 13496 13194
query15 358 237 239 237
query16 6430 275 264 264
query17 1483 1502 855 855
query18 2303 399 399 399
query19 209 142 152 142
query20 72 77 75 75
query21 184 95 94 94
query22 5259 5063 5056 5056
query23 32288 31742 31847 31742
query24 6726 6480 6446 6446
query25 511 420 420 420
query26 519 157 161 157
query27 1898 299 297 297
query28 6048 2208 2172 2172
query29 2781 2743 2850 2743
query30 247 160 159 159
query31 887 731 752 731
query32 69 59 58 58
query33 399 236 258 236
query34 847 484 502 484
query35 1147 897 958 897
query36 1753 1524 1651 1524
query37 92 61 57 57
query38 3050 2920 2885 2885
query39 1404 1305 1309 1305
query40 207 95 95 95
query41 35 32 32 32
query42 90 83 83 83
query43 653 645 598 598
query44 1133 713 723 713
query45 237 227 227 227
query46 1236 954 971 954
query47 1977 1900 1838 1838
query48 992 704 663 663
query49 596 372 364 364
query50 874 668 609 609
query51 4748 4637 4662 4637
query52 84 77 82 77
query53 440 328 320 320
query54 2659 2472 2457 2457
query55 89 74 84 74
query56 199 215 209 209
query57 1157 1111 1039 1039
query58 213 192 207 192
query59 3481 3438 3280 3280
query60 211 191 213 191
query61 86 82 84 82
query62 887 532 520 520
query63 470 346 338 338
query64 2448 1480 1357 1357
query65 3636 3960 3559 3559
query66 762 385 351 351
query67 18201 16483 15258 15258
query68 8422 647 638 638
query69 564 350 352 350
query70 1836 1593 1898 1593
query71 402 300 298 298
query72 6438 3454 3401 3401
query73 734 319 315 315
query74 6252 5836 5848 5836
query75 4939 3730 3677 3677
query76 4965 1137 1243 1137
query77 737 249 245 245
query78 12591 11880 11921 11880
query79 6953 627 641 627
query80 1000 391 401 391
query81 492 227 229 227
query82 1530 95 93 93
query83 168 130 133 130
query84 268 68 69 68
query85 856 284 272 272
query86 394 421 361 361
query87 3216 2999 2992 2992
query88 4782 2346 2331 2331
query89 348 299 305 299
query90 1956 211 204 204
query91 149 112 124 112
query92 57 52 53 52
query93 4329 568 563 563
query94 730 205 199 199
query95 1093 1053 1055 1053
query96 647 325 343 325
query97 6484 6407 6522 6407
query98 185 181 177 177
query99 2970 871 922 871
Total cold run time: 308864 ms
Total hot run time: 201742 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980669461
<details>
<summary>ClickBench: <b>Total hot run time: 30.34 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f69d4a5b927139e00f7307d57e081ee577b17a20, data reload: false
query1 0.02 0.02 0.03
query2 0.07 0.02 0.02
query3 0.25 0.04 0.04
query4 1.80 0.06 0.05
query5 0.53 0.52 0.52
query6 1.24 0.61 0.62
query7 0.02 0.02 0.01
query8 0.03 0.02 0.02
query9 0.52 0.48 0.48
query10 0.53 0.53 0.53
query11 0.12 0.09 0.08
query12 0.12 0.09 0.09
query13 0.62 0.63 0.62
query14 0.78 0.79 0.79
query15 0.79 0.76 0.76
query16 0.37 0.37 0.36
query17 0.98 0.95 0.99
query18 0.24 0.23 0.25
query19 1.92 1.87 1.81
query20 0.01 0.01 0.01
query21 15.46 0.56 0.56
query22 1.99 2.17 1.48
query23 17.32 1.05 0.83
query24 6.70 1.03 0.92
query25 0.41 0.13 0.04
query26 0.66 0.16 0.15
query27 0.04 0.04 0.03
query28 6.52 0.74 0.71
query29 12.75 2.27 2.30
query30 0.56 0.53 0.52
query31 2.81 0.39 0.37
query32 3.40 0.49 0.48
query33 3.10 3.07 3.07
query34 15.24 4.82 4.79
query35 4.88 4.86 4.85
query36 1.05 1.02 1.01
query37 0.06 0.04 0.04
query38 0.03 0.02 0.02
query39 0.02 0.02 0.02
query40 0.16 0.14 0.14
query41 0.07 0.02 0.02
query42 0.02 0.01 0.01
query43 0.02 0.01 0.02
Total cold run time: 104.23 s
Total hot run time: 30.34 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980490886
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [opt](session variable) max_msg_size_of_result_receiver #31809 [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31867:
URL: https://github.com/apache/doris/pull/31867#issuecomment-1980633214
<details>
<summary>TPC-H: <b>Total hot run time: 49880 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f69d4a5b927139e00f7307d57e081ee577b17a20, data reload: false
------ Round 1 ----------------------------------
q1 18033 4366 4343 4343
q2 2024 148 140 140
q3 10433 1883 1931 1883
q4 10334 1289 1308 1289
q5 8448 3882 4033 3882
q6 224 122 122 122
q7 2045 1600 1616 1600
q8 9422 2714 2704 2704
q9 11206 10594 10549 10549
q10 8635 3551 3478 3478
q11 421 247 243 243
q12 466 304 303 303
q13 18376 3918 4063 3918
q14 341 323 319 319
q15 502 459 460 459
q16 688 591 585 585
q17 1124 949 960 949
q18 7244 6809 6796 6796
q19 1695 1584 1547 1547
q20 530 310 309 309
q21 4418 4071 4092 4071
q22 501 391 403 391
Total cold run time: 117110 ms
Total hot run time: 49880 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4330 4281 4291 4281
q2 319 228 228 228
q3 4148 4151 4128 4128
q4 2723 2766 2733 2733
q5 7261 7179 7273 7179
q6 233 125 119 119
q7 3236 2822 2802 2802
q8 4285 4411 4377 4377
q9 17681 17290 17233 17233
q10 4187 4214 4251 4214
q11 767 659 676 659
q12 1020 838 833 833
q13 6539 3747 3736 3736
q14 460 427 426 426
q15 501 463 454 454
q16 751 700 689 689
q17 3820 3774 3780 3774
q18 8690 8874 8805 8805
q19 1711 1724 1671 1671
q20 2473 2234 2178 2178
q21 8747 8315 8446 8315
q22 1051 947 942 942
Total cold run time: 84933 ms
Total hot run time: 79776 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org