You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Gabriel39 (via GitHub)" <gi...@apache.org> on 2024/01/15 07:23:56 UTC
[PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Gabriel39 opened a new pull request, #29980:
URL: https://github.com/apache/doris/pull/29980
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891701144
TeamCity be ut coverage result:
Function Coverage: 36.68% (8648/23577)
Line Coverage: 28.70% (70456/245462)
Region Coverage: 27.63% (36422/131841)
Branch Coverage: 24.35% (18633/76526)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a0c24377d3d38bc374b2ccad5d3f040dd78769b0_a0c24377d3d38bc374b2ccad5d3f040dd78769b0/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891459043
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1892162455
<details>
<summary>ClickBench: <b>Total hot run time: 31.62 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0, data reload: false
query1 0.05 0.06 0.06
query2 0.06 0.02 0.02
query3 0.25 0.12 0.11
query4 1.76 0.12 0.11
query5 0.54 0.53 0.53
query6 1.28 0.65 0.64
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.57 0.50 0.50
query10 0.56 0.56 0.55
query11 0.13 0.09 0.08
query12 0.12 0.09 0.09
query13 0.60 0.60 0.59
query14 0.79 0.81 0.79
query15 0.79 0.77 0.77
query16 0.36 0.39 0.38
query17 1.00 1.01 1.00
query18 0.23 0.28 0.25
query19 1.87 1.76 1.80
query20 0.02 0.01 0.01
query21 15.41 0.55 0.57
query22 2.97 2.43 2.14
query23 17.34 0.88 0.80
query24 2.28 1.16 1.17
query25 0.42 0.23 0.16
query26 0.57 0.15 0.14
query27 0.06 0.07 0.05
query28 11.22 0.80 0.82
query29 12.54 3.29 3.24
query30 0.58 0.48 0.55
query31 2.77 0.34 0.35
query32 3.39 0.49 0.48
query33 3.24 3.25 3.23
query34 15.68 4.28 4.23
query35 4.25 4.24 4.33
query36 1.11 1.08 1.07
query37 0.06 0.04 0.05
query38 0.03 0.02 0.03
query39 0.03 0.01 0.02
query40 0.16 0.13 0.13
query41 0.08 0.01 0.02
query42 0.03 0.02 0.01
query43 0.03 0.02 0.02
Total cold run time: 105.28 s
Total hot run time: 31.62 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891751428
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.51 seconds
stream load tsv: 559 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 21.9 seconds inserted 10000000 Rows, about 456K ops/s
storage size: 17183812844 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891492040
TeamCity be ut coverage result:
Function Coverage: 36.69% (8649/23575)
Line Coverage: 28.71% (70469/245446)
Region Coverage: 27.63% (36430/131839)
Branch Coverage: 24.35% (18634/76524)
Coverage Report: http://coverage.selectdb-in.cc/coverage/75ee5b7a9320670c2964b7eafed6d0fed2a5875c_75ee5b7a9320670c2964b7eafed6d0fed2a5875c/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891860291
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891780709
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0 with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 13.3 seconds inserted 10000000 Rows, about 751K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1892201394
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891524568
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 75ee5b7a9320670c2964b7eafed6d0fed2a5875c with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.2 seconds inserted 10000000 Rows, about 704K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 merged PR #29980:
URL: https://github.com/apache/doris/pull/29980
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1892093880
run performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891579038
TeamCity be ut coverage result:
Function Coverage: 36.68% (8647/23575)
Line Coverage: 28.69% (70430/245447)
Region Coverage: 27.61% (36406/131836)
Branch Coverage: 24.33% (18622/76524)
Coverage Report: http://coverage.selectdb-in.cc/coverage/f44d519a254069e1f1a6b9fda49e12002559d789_f44d519a254069e1f1a6b9fda49e12002559d789/report/index.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1892153744
<details>
<summary>TPC-DS: <b>Total hot run time: 178677 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0, data reload: false
query1 925 333 327 327
query2 6753 1785 1796 1785
query3 6711 206 204 204
query4 34373 22352 22010 22010
query5 6956 601 558 558
query6 257 184 184 184
query7 4634 283 267 267
query8 236 222 203 203
query9 9063 2761 2666 2666
query10 663 268 247 247
query11 17058 15379 15266 15266
query12 123 71 69 69
query13 1703 379 388 379
query14 11245 7447 7486 7447
query15 217 184 192 184
query16 4614 257 258 257
query17 995 499 479 479
query18 1802 279 264 264
query19 184 152 145 145
query20 83 80 72 72
query21 200 134 135 134
query22 4894 4769 4721 4721
query23 31989 31164 31181 31164
query24 12865 2772 2872 2772
query25 568 342 322 322
query26 1926 158 155 155
query27 3645 273 279 273
query28 7450 1870 1847 1847
query29 2214 709 672 672
query30 285 139 140 139
query31 958 762 768 762
query32 76 60 63 60
query33 711 246 239 239
query34 1234 466 479 466
query35 893 830 784 784
query36 1387 1302 1342 1302
query37 189 68 70 68
query38 3401 3285 3255 3255
query39 1348 1273 1279 1273
query40 340 102 95 95
query41 39 39 35 35
query42 100 96 95 95
query43 559 514 510 510
query44 1095 706 721 706
query45 199 192 181 181
query46 1064 652 647 647
query47 1656 1543 1612 1543
query48 400 319 320 319
query49 1254 311 315 311
query50 695 319 327 319
query51 5289 5275 5141 5141
query52 102 91 96 91
query53 347 293 307 293
query54 907 467 462 462
query55 95 93 83 83
query56 194 206 191 191
query57 1027 938 963 938
query58 217 192 190 190
query59 3016 2763 2712 2712
query60 242 222 213 213
query61 82 84 81 81
query62 675 410 407 407
query63 316 302 292 292
query64 6297 1676 1658 1658
query65 3372 3297 3260 3260
query66 1449 333 323 323
query67 15619 15059 15127 15059
query68 11926 516 508 508
query69 643 336 333 333
query70 1724 1613 1548 1548
query71 574 247 240 240
query72 5046 2850 2869 2850
query73 2703 323 315 315
query74 6955 6405 6450 6405
query75 5348 2378 2303 2303
query76 6303 927 1056 927
query77 917 280 265 265
query78 9306 8616 8662 8616
query79 1030 516 513 513
query80 647 344 355 344
query81 446 213 205 205
query82 208 94 94 94
query83 159 126 121 121
query84 284 74 74 74
query85 1063 334 327 327
query86 377 380 411 380
query87 3572 3379 3348 3348
query88 3179 2227 2218 2218
query89 486 388 369 369
query90 2159 225 201 201
query91 155 131 124 124
query92 63 57 55 55
query93 1349 409 437 409
query94 1328 179 180 179
query95 523 482 476 476
query96 644 314 318 314
query97 4318 4145 4166 4145
query98 210 199 187 187
query99 1071 708 735 708
Total cold run time: 306191 ms
Total hot run time: 178677 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891556186
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891721173
<details>
<summary>TPC-H: <b>Total hot run time: 40196 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0, data reload: false
------ Round 1 ----------------------------------
q1 18655 6271 5906 5906
q2 2670 153 183 153
q3 11279 1181 1208 1181
q4 10556 795 769 769
q5 8144 3257 3223 3223
q6 210 129 128 128
q7 934 530 489 489
q8 9372 2001 2024 2001
q9 7325 6459 6439 6439
q10 8250 3103 3098 3098
q11 415 217 214 214
q12 365 195 198 195
q13 18105 3391 3409 3391
q14 250 217 222 217
q15 553 529 510 510
q16 439 385 394 385
q17 959 498 564 498
q18 7778 6921 6923 6921
q19 1618 1346 1388 1346
q20 526 325 309 309
q21 2902 2519 2512 2512
q22 385 328 311 311
Total cold run time: 111690 ms
Total hot run time: 40196 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5887 5780 5713 5713
q2 345 218 219 218
q3 3307 3143 3247 3143
q4 2202 2135 2095 2095
q5 6031 5979 6048 5979
q6 211 124 123 123
q7 2388 1986 1934 1934
q8 3559 3817 3760 3760
q9 9811 25865 9405 9405
q10 5831 3724 3808 3724
q11 673 451 447 447
q12 1102 635 652 635
q13 17158 3279 3241 3241
q14 377 250 273 250
q15 580 506 501 501
q16 555 517 501 501
q17 8936 1974 2035 1974
q18 9671 9444 13002 9444
q19 13904 1622 1613 1613
q20 4158 1941 1947 1941
q21 13817 5627 5540 5540
q22 937 607 599 599
Total cold run time: 111440 ms
Total hot run time: 62780 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891464793
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891764616
<details>
<summary>TPC-DS: <b>Total hot run time: 178972 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0, data reload: false
query1 946 342 320 320
query2 6733 1896 1844 1844
query3 6723 216 205 205
query4 35428 22173 22164 22164
query5 6930 579 517 517
query6 268 180 179 179
query7 4622 277 274 274
query8 234 193 209 193
query9 9236 2769 2935 2769
query10 470 248 249 248
query11 16846 15432 15300 15300
query12 121 77 78 77
query13 1706 367 378 367
query14 11203 7351 7296 7296
query15 215 181 185 181
query16 4630 244 246 244
query17 1007 499 479 479
query18 1807 263 256 256
query19 185 150 152 150
query20 82 80 70 70
query21 192 125 130 125
query22 5029 4853 4826 4826
query23 31813 30957 30912 30912
query24 12625 2811 2740 2740
query25 574 324 340 324
query26 1840 153 150 150
query27 3252 279 263 263
query28 7265 1866 1857 1857
query29 2182 677 684 677
query30 292 138 138 138
query31 944 755 767 755
query32 76 61 61 61
query33 731 245 245 245
query34 1177 458 450 450
query35 882 775 799 775
query36 1404 1275 1261 1261
query37 188 70 67 67
query38 3421 3281 3327 3281
query39 1328 1256 1283 1256
query40 337 95 94 94
query41 37 36 35 35
query42 106 96 97 96
query43 589 548 518 518
query44 1048 701 723 701
query45 198 189 179 179
query46 1050 642 650 642
query47 1677 1542 1591 1542
query48 400 324 322 322
query49 1261 314 297 297
query50 711 310 312 310
query51 5327 5170 5186 5170
query52 107 97 94 94
query53 350 291 290 290
query54 909 437 467 437
query55 89 82 84 82
query56 212 186 189 186
query57 1028 982 960 960
query58 211 189 184 184
query59 2984 2743 2736 2736
query60 246 222 231 222
query61 82 84 85 84
query62 683 402 444 402
query63 310 286 289 286
query64 6290 1690 1674 1674
query65 3355 3250 3254 3250
query66 1414 322 324 322
query67 15697 15258 15365 15258
query68 12135 504 501 501
query69 674 333 337 333
query70 1650 1642 1576 1576
query71 565 250 277 250
query72 5070 2838 2873 2838
query73 2736 315 312 312
query74 7993 6527 6487 6487
query75 5109 2334 2265 2265
query76 6265 944 1061 944
query77 763 257 282 257
query78 9482 8716 8965 8716
query79 1021 499 505 499
query80 574 346 332 332
query81 446 203 205 203
query82 209 88 93 88
query83 145 121 131 121
query84 275 76 74 74
query85 1072 346 327 327
query86 414 437 373 373
query87 3625 3391 3391 3391
query88 3230 2206 2206 2206
query89 455 389 376 376
query90 2021 200 195 195
query91 152 126 131 126
query92 62 57 55 55
query93 1461 436 417 417
query94 1267 177 180 177
query95 515 479 466 466
query96 609 313 311 311
query97 4326 4169 4156 4156
query98 210 195 186 186
query99 1063 762 745 745
Total cold run time: 306909 ms
Total hot run time: 178972 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891597414
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891491367
<details>
<summary>TPC-H: <b>Total hot run time: 39650 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 75ee5b7a9320670c2964b7eafed6d0fed2a5875c, data reload: false
------ Round 1 ----------------------------------
q1 17978 6061 5861 5861
q2 2048 146 132 132
q3 10904 1107 1210 1107
q4 10552 824 814 814
q5 7842 3103 3194 3103
q6 206 126 126 126
q7 869 506 486 486
q8 9330 1962 2004 1962
q9 7283 6416 6359 6359
q10 8236 3083 3063 3063
q11 416 207 215 207
q12 367 194 192 192
q13 18123 3395 3459 3395
q14 239 222 214 214
q15 567 519 516 516
q16 441 397 394 394
q17 943 513 500 500
q18 7602 7036 6935 6935
q19 1622 1400 1282 1282
q20 575 340 310 310
q21 2818 2374 2496 2374
q22 389 333 318 318
Total cold run time: 109350 ms
Total hot run time: 39650 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5894 5799 5806 5799
q2 360 224 222 222
q3 3348 3182 3101 3101
q4 2199 1992 2016 1992
q5 6110 5882 5878 5878
q6 203 121 122 121
q7 2377 1931 1942 1931
q8 3540 3767 3638 3638
q9 9831 23761 9494 9494
q10 11870 3806 3841 3806
q11 710 456 469 456
q12 1741 662 630 630
q13 17451 3304 3251 3251
q14 402 256 266 256
q15 577 511 512 511
q16 549 493 480 480
q17 10339 2025 1984 1984
q18 9674 9718 9433 9433
q19 12227 1592 1639 1592
q20 3423 1956 1924 1924
q21 15636 6020 5568 5568
q22 2319 619 594 594
Total cold run time: 120780 ms
Total hot run time: 62661 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891612568
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891625090
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891647006
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891544915
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891579706
<details>
<summary>TPC-H: <b>Total hot run time: 40123 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f44d519a254069e1f1a6b9fda49e12002559d789, data reload: false
------ Round 1 ----------------------------------
q1 18853 6765 5837 5837
q2 2349 166 153 153
q3 11870 1190 1190 1190
q4 10672 814 910 814
q5 8099 3223 3301 3223
q6 207 127 126 126
q7 905 504 479 479
q8 9286 2004 1997 1997
q9 7310 6478 6454 6454
q10 8223 3114 3054 3054
q11 427 213 219 213
q12 367 196 199 196
q13 18112 3464 3435 3435
q14 256 225 218 218
q15 562 519 512 512
q16 450 400 402 400
q17 960 488 502 488
q18 7860 6937 6944 6937
q19 1647 1328 1415 1328
q20 545 316 303 303
q21 2749 2470 2432 2432
q22 375 334 343 334
Total cold run time: 112084 ms
Total hot run time: 40123 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5864 5708 5582 5582
q2 340 240 228 228
q3 3419 3258 3189 3189
q4 2281 2043 2071 2043
q5 6073 5967 5937 5937
q6 208 130 127 127
q7 2419 1995 1993 1993
q8 3615 3797 3763 3763
q9 9974 25133 9554 9554
q10 10341 3773 3811 3773
q11 716 474 479 474
q12 1372 659 648 648
q13 17357 3274 3279 3274
q14 296 266 267 266
q15 574 510 503 503
q16 558 508 479 479
q17 8510 2066 2086 2066
q18 9608 10093 9503 9503
q19 15078 1603 1615 1603
q20 3350 1941 1949 1941
q21 17501 6221 5524 5524
q22 967 600 640 600
Total cold run time: 120421 ms
Total hot run time: 63070 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891775532
<details>
<summary>ClickBench: <b>Total hot run time: 30.21 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0, data reload: false
query1 0.05 0.06 0.05
query2 0.06 0.02 0.02
query3 0.25 0.11 0.12
query4 1.79 0.13 0.12
query5 0.54 0.53 0.53
query6 1.38 0.64 0.64
query7 0.02 0.01 0.01
query8 0.04 0.03 0.03
query9 0.56 0.49 0.51
query10 0.57 0.55 0.56
query11 0.12 0.09 0.09
query12 0.11 0.09 0.10
query13 0.61 0.61 0.60
query14 0.76 0.79 0.80
query15 0.79 0.80 0.76
query16 0.39 0.37 0.37
query17 1.02 1.02 1.05
query18 0.23 0.26 0.27
query19 1.82 1.81 1.81
query20 0.01 0.00 0.01
query21 15.40 0.55 0.58
query22 2.95 2.35 1.34
query23 17.23 0.76 0.76
query24 2.61 0.72 0.46
query25 0.40 0.16 0.17
query26 0.49 0.14 0.15
query27 0.06 0.05 0.05
query28 12.66 0.78 0.80
query29 12.54 3.30 3.31
query30 0.59 0.55 0.49
query31 2.78 0.35 0.37
query32 3.38 0.48 0.49
query33 3.22 3.23 3.22
query34 15.98 4.37 4.20
query35 4.30 4.25 4.23
query36 1.12 1.09 1.09
query37 0.06 0.05 0.05
query38 0.04 0.02 0.02
query39 0.02 0.02 0.02
query40 0.16 0.14 0.13
query41 0.07 0.02 0.01
query42 0.02 0.02 0.02
query43 0.02 0.02 0.02
Total cold run time: 107.22 s
Total hot run time: 30.21 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1892188212
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891513300
<details>
<summary>TPC-DS: <b>Total hot run time: 179498 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 75ee5b7a9320670c2964b7eafed6d0fed2a5875c, data reload: false
query1 935 332 336 332
query2 6726 1883 1867 1867
query3 6750 211 207 207
query4 33261 22250 22257 22250
query5 6939 548 594 548
query6 275 179 195 179
query7 4618 268 278 268
query8 246 197 195 195
query9 9058 2750 2873 2750
query10 486 246 252 246
query11 16380 15404 15272 15272
query12 128 77 76 76
query13 1711 380 367 367
query14 11368 7357 7431 7357
query15 218 177 179 177
query16 4636 251 250 250
query17 997 497 490 490
query18 1806 272 260 260
query19 197 153 148 148
query20 82 83 71 71
query21 195 147 125 125
query22 4960 4765 4695 4695
query23 31727 31138 31348 31138
query24 11503 2866 2857 2857
query25 576 325 326 325
query26 1369 150 151 150
query27 3245 281 275 275
query28 7008 1880 1852 1852
query29 1313 709 679 679
query30 285 137 141 137
query31 934 761 764 761
query32 80 64 59 59
query33 717 241 247 241
query34 1157 461 452 452
query35 924 791 786 786
query36 1453 1311 1253 1253
query37 103 81 70 70
query38 3372 3323 3228 3228
query39 1352 1297 1287 1287
query40 211 97 92 92
query41 40 36 35 35
query42 107 99 95 95
query43 548 507 517 507
query44 1083 705 723 705
query45 205 190 185 185
query46 1061 648 634 634
query47 1666 1640 1630 1630
query48 401 328 318 318
query49 1152 321 306 306
query50 701 317 323 317
query51 5360 5276 5171 5171
query52 102 86 97 86
query53 359 299 307 299
query54 906 461 464 461
query55 96 87 90 87
query56 222 193 202 193
query57 1001 960 956 956
query58 219 197 193 193
query59 3013 2889 2853 2853
query60 239 238 222 222
query61 82 81 81 81
query62 691 417 423 417
query63 310 279 287 279
query64 5032 1659 1664 1659
query65 3360 3288 3283 3283
query66 1237 333 332 332
query67 15665 15255 15350 15255
query68 11632 524 495 495
query69 637 352 339 339
query70 1656 1552 1598 1552
query71 544 239 243 239
query72 4969 2872 2851 2851
query73 2254 316 316 316
query74 7013 6450 6442 6442
query75 4911 2301 2264 2264
query76 6129 937 1080 937
query77 683 283 288 283
query78 9348 8811 8640 8640
query79 1016 490 496 490
query80 551 351 345 345
query81 469 207 203 203
query82 213 96 87 87
query83 153 129 125 125
query84 279 76 76 76
query85 1062 331 315 315
query86 403 408 372 372
query87 3551 3364 3382 3364
query88 2821 2216 2226 2216
query89 474 398 384 384
query90 2036 208 203 203
query91 153 121 121 121
query92 62 59 53 53
query93 1367 401 410 401
query94 1246 180 181 180
query95 514 479 469 469
query96 622 314 318 314
query97 4277 4154 4190 4154
query98 215 192 188 188
query99 1038 758 749 749
Total cold run time: 296457 ms
Total hot run time: 179498 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891860458
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1892135459
<details>
<summary>TPC-H: <b>Total hot run time: 40128 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0, data reload: false
------ Round 1 ----------------------------------
q1 19015 6937 5909 5909
q2 2333 184 172 172
q3 12937 1149 1168 1149
q4 10682 826 785 785
q5 8082 3269 3263 3263
q6 209 130 125 125
q7 903 492 481 481
q8 9257 2039 2039 2039
q9 7297 6453 6447 6447
q10 8201 3050 3080 3050
q11 419 208 203 203
q12 357 194 199 194
q13 18115 3441 3398 3398
q14 255 224 225 224
q15 581 519 516 516
q16 441 377 376 376
q17 951 520 560 520
q18 7767 7013 7013 7013
q19 1886 1244 1438 1244
q20 583 291 312 291
q21 2774 2403 2495 2403
q22 353 336 326 326
Total cold run time: 113398 ms
Total hot run time: 40128 ms
----- Round 2, with runtime_filter_mode=off -----
q1 5909 5597 5640 5597
q2 354 223 223 223
q3 3352 3245 3162 3162
q4 2244 2075 2024 2024
q5 6118 5914 5899 5899
q6 203 123 119 119
q7 2471 1920 1902 1902
q8 3634 3683 3721 3683
q9 9752 23222 9728 9728
q10 4256 3879 3871 3871
q11 617 461 470 461
q12 1165 666 659 659
q13 17120 3279 3246 3246
q14 313 257 263 257
q15 584 515 515 515
q16 580 481 465 465
q17 4779 2010 2012 2010
q18 9617 9420 9676 9420
q19 9910 1610 1615 1610
q20 3630 1956 1947 1947
q21 12769 5703 5777 5703
q22 859 594 611 594
Total cold run time: 100236 ms
Total hot run time: 63095 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891612043
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891520322
<details>
<summary>ClickBench: <b>Total hot run time: 30.17 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 75ee5b7a9320670c2964b7eafed6d0fed2a5875c, data reload: false
query1 0.06 0.05 0.05
query2 0.07 0.02 0.02
query3 0.26 0.12 0.12
query4 1.75 0.12 0.11
query5 0.54 0.52 0.53
query6 1.32 0.64 0.64
query7 0.02 0.02 0.01
query8 0.04 0.02 0.02
query9 0.53 0.54 0.49
query10 0.57 0.56 0.58
query11 0.12 0.09 0.08
query12 0.11 0.09 0.09
query13 0.60 0.60 0.60
query14 0.79 0.78 0.80
query15 0.80 0.78 0.78
query16 0.39 0.39 0.37
query17 1.01 1.01 1.03
query18 0.26 0.25 0.25
query19 1.89 1.79 1.77
query20 0.01 0.01 0.02
query21 15.40 0.56 0.54
query22 2.67 3.26 1.66
query23 17.36 0.84 0.81
query24 2.70 0.27 0.30
query25 0.31 0.31 0.11
query26 0.42 0.14 0.14
query27 0.06 0.06 0.05
query28 12.63 0.79 0.78
query29 12.56 3.30 3.29
query30 0.53 0.51 0.47
query31 2.78 0.34 0.36
query32 3.38 0.48 0.48
query33 3.24 3.21 3.22
query34 15.78 4.29 4.16
query35 4.27 4.27 4.24
query36 1.14 1.09 1.10
query37 0.07 0.05 0.05
query38 0.04 0.02 0.03
query39 0.02 0.01 0.02
query40 0.18 0.13 0.12
query41 0.08 0.02 0.02
query42 0.03 0.01 0.01
query43 0.03 0.02 0.02
Total cold run time: 106.82 s
Total hot run time: 30.17 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891666594
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891512340
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.5 seconds
stream load tsv: 559 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 21.4 seconds inserted 10000000 Rows, about 467K ops/s
storage size: 17183469147 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1891646895
<details>
<summary>TPC-H: <b>Total hot run time: 40147 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8c8dc1b50c0e9886a4ef1ff44b6be052a473df74, data reload: false
------ Round 1 ----------------------------------
q1 19164 7031 5799 5799
q2 2114 183 156 156
q3 11222 1165 1223 1165
q4 10570 773 899 773
q5 8224 3292 3238 3238
q6 216 128 131 128
q7 988 502 494 494
q8 9258 1984 2033 1984
q9 7367 6423 6377 6377
q10 8228 3125 3081 3081
q11 419 216 199 199
q12 365 194 194 194
q13 18111 3451 3407 3407
q14 234 221 215 215
q15 577 508 512 508
q16 460 395 368 368
q17 956 571 576 571
q18 7877 7177 7017 7017
q19 1637 1396 1395 1395
q20 528 304 329 304
q21 2847 2459 2486 2459
q22 387 331 315 315
Total cold run time: 111749 ms
Total hot run time: 40147 ms
----- Round 2, with runtime_filter_mode=off -----
q1 6117 5740 5948 5740
q2 335 226 223 223
q3 3340 3193 3123 3123
q4 2277 2091 2037 2037
q5 6097 6106 5986 5986
q6 205 125 127 125
q7 2314 1936 1976 1936
q8 3643 3714 3768 3714
q9 9777 24408 9431 9431
q10 9246 3835 3788 3788
q11 640 465 464 464
q12 1250 654 618 618
q13 17121 3287 3262 3262
q14 362 257 259 257
q15 576 518 500 500
q16 567 471 466 466
q17 9157 1965 1856 1856
q18 9573 9390 12742 9390
q19 13922 1625 1605 1605
q20 4763 1945 1920 1920
q21 15048 5681 5980 5681
q22 1300 602 568 568
Total cold run time: 117630 ms
Total hot run time: 62690 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](fix) Fix input data distribution for distinct streaming agg [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29980:
URL: https://github.com/apache/doris/pull/29980#issuecomment-1892167331
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit a0c24377d3d38bc374b2ccad5d3f040dd78769b0 with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 14.9 seconds inserted 10000000 Rows, about 671K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org