You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Gabriel39 (via GitHub)" <gi...@apache.org> on 2024/02/23 08:36:58 UTC
[PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Gabriel39 opened a new pull request, #31328:
URL: https://github.com/apache/doris/pull/31328
…
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961344208
<details>
<summary>ClickBench: <b>Total hot run time: 31.22 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 721c9885a1fa385e7ea20be8d80ad9b7dc4f902b, data reload: false
query1 0.03 0.02 0.02
query2 0.06 0.02 0.02
query3 0.23 0.07 0.07
query4 1.66 0.08 0.08
query5 0.48 0.48 0.49
query6 1.41 0.61 0.62
query7 0.02 0.01 0.01
query8 0.03 0.02 0.02
query9 0.52 0.45 0.45
query10 0.48 0.48 0.50
query11 0.12 0.09 0.10
query12 0.12 0.09 0.10
query13 0.58 0.58 0.58
query14 0.76 0.79 0.78
query15 0.83 0.80 0.78
query16 0.34 0.34 0.34
query17 0.94 0.88 0.90
query18 0.18 0.17 0.16
query19 1.79 1.70 1.70
query20 0.02 0.01 0.02
query21 15.40 0.65 0.60
query22 2.99 3.77 2.53
query23 17.74 0.99 0.99
query24 2.00 0.75 0.37
query25 0.62 0.08 0.07
query26 0.15 0.14 0.14
query27 0.06 0.05 0.06
query28 11.82 0.83 0.82
query29 12.56 3.38 3.39
query30 0.54 0.48 0.49
query31 2.79 0.36 0.36
query32 3.35 0.48 0.47
query33 3.10 3.14 3.17
query34 15.34 4.49 4.46
query35 4.50 4.54 4.51
query36 1.07 0.93 0.96
query37 0.07 0.06 0.05
query38 0.04 0.03 0.03
query39 0.02 0.02 0.02
query40 0.20 0.13 0.14
query41 0.08 0.01 0.01
query42 0.02 0.01 0.02
query43 0.02 0.02 0.02
Total cold run time: 105.08 s
Total hot run time: 31.22 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961261659
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961320104
<details>
<summary>TPC-H: <b>Total hot run time: 41074 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 721c9885a1fa385e7ea20be8d80ad9b7dc4f902b, data reload: false
------ Round 1 ----------------------------------
q1 17710 4985 4924 4924
q2 2038 140 132 132
q3 10584 1003 979 979
q4 4656 951 981 951
q5 7616 3188 3196 3188
q6 198 135 131 131
q7 1252 775 756 756
q8 9232 2040 2060 2040
q9 7490 6569 6621 6569
q10 8306 2640 2652 2640
q11 403 220 201 201
q12 749 332 325 325
q13 17932 3620 3639 3620
q14 295 258 257 257
q15 621 521 495 495
q16 477 404 412 404
q17 917 897 855 855
q18 7494 6589 6606 6589
q19 1527 1480 1493 1480
q20 562 283 265 265
q21 6790 3931 3942 3931
q22 875 345 342 342
Total cold run time: 107724 ms
Total hot run time: 41074 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4906 4936 4871 4871
q2 302 188 198 188
q3 3652 3605 3614 3605
q4 2525 2525 2529 2525
q5 5771 5744 5770 5744
q6 209 125 129 125
q7 2254 1653 1631 1631
q8 3006 3081 3100 3081
q9 8667 8659 8621 8621
q10 6756 4236 4241 4236
q11 569 375 368 368
q12 786 549 554 549
q13 5371 3434 3391 3391
q14 271 246 239 239
q15 599 505 496 496
q16 486 417 455 417
q17 1713 1635 1700 1635
q18 8414 7755 7722 7722
q19 1635 1635 1627 1627
q20 2120 1838 1829 1829
q21 6638 6233 6305 6233
q22 578 510 506 506
Total cold run time: 67228 ms
Total hot run time: 59639 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961050952
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961580242
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit bd69447acb363a6e904f9949ffdf50f93c2ece8d with default session variables
Stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc: 59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select: 16.7 seconds inserted 10000000 Rows, about 598K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961515869
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1962182965
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961454672
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961348802
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Load test result on commit 721c9885a1fa385e7ea20be8d80ad9b7dc4f902b with default session variables
Stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc: 60 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select: 13.9 seconds inserted 10000000 Rows, about 719K ops/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961574843
<details>
<summary>ClickBench: <b>Total hot run time: 31.03 s</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bd69447acb363a6e904f9949ffdf50f93c2ece8d, data reload: false
query1 0.02 0.02 0.02
query2 0.06 0.02 0.03
query3 0.23 0.07 0.06
query4 1.66 0.08 0.08
query5 0.48 0.50 0.49
query6 1.36 0.61 0.62
query7 0.01 0.01 0.02
query8 0.04 0.03 0.03
query9 0.54 0.46 0.46
query10 0.50 0.49 0.49
query11 0.13 0.10 0.10
query12 0.12 0.10 0.10
query13 0.58 0.59 0.58
query14 0.75 0.78 0.78
query15 0.81 0.80 0.80
query16 0.34 0.34 0.35
query17 0.92 0.91 0.91
query18 0.19 0.16 0.18
query19 1.82 1.70 1.69
query20 0.02 0.01 0.01
query21 15.40 0.62 0.56
query22 2.67 3.52 2.48
query23 17.51 1.03 0.94
query24 2.17 0.34 0.50
query25 0.62 0.07 0.05
query26 0.16 0.14 0.13
query27 0.06 0.05 0.06
query28 11.96 0.84 0.81
query29 12.58 3.30 3.28
query30 0.53 0.48 0.49
query31 2.79 0.35 0.36
query32 3.33 0.47 0.48
query33 3.15 3.11 3.20
query34 15.37 4.53 4.50
query35 4.52 4.51 4.51
query36 1.09 0.96 0.97
query37 0.07 0.05 0.05
query38 0.04 0.03 0.03
query39 0.02 0.01 0.02
query40 0.18 0.14 0.15
query41 0.07 0.02 0.01
query42 0.02 0.01 0.01
query43 0.02 0.03 0.02
Total cold run time: 104.91 s
Total hot run time: 31.03 s
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1960921718
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1960937505
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1960937569
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961336285
<details>
<summary>TPC-DS: <b>Total hot run time: 176493 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 721c9885a1fa385e7ea20be8d80ad9b7dc4f902b, data reload: false
query1 917 355 349 349
query2 6521 1798 1707 1707
query3 6698 206 203 203
query4 22812 21233 21109 21109
query5 4243 385 374 374
query6 264 171 167 167
query7 4647 302 293 293
query8 250 190 195 190
query9 8447 2838 2844 2838
query10 421 213 239 213
query11 14915 14557 14378 14378
query12 142 81 86 81
query13 1714 423 421 421
query14 9283 7675 7642 7642
query15 220 201 197 197
query16 7484 246 245 245
query17 1429 551 527 527
query18 1948 270 258 258
query19 197 142 149 142
query20 87 85 86 85
query21 189 125 127 125
query22 4925 4740 4685 4685
query23 32460 31431 31489 31431
query24 12656 3324 3366 3324
query25 669 358 368 358
query26 1867 163 162 162
query27 3042 313 322 313
query28 6623 1824 1815 1815
query29 1122 620 612 612
query30 284 135 151 135
query31 952 739 753 739
query32 100 60 58 58
query33 735 226 229 226
query34 1081 484 505 484
query35 950 829 816 816
query36 1021 921 967 921
query37 167 62 64 62
query38 3355 3279 3238 3238
query39 1416 1353 1338 1338
query40 289 108 110 108
query41 39 36 35 35
query42 105 101 109 101
query43 470 447 456 447
query44 1073 679 695 679
query45 201 182 182 182
query46 1051 797 777 777
query47 1610 1519 1542 1519
query48 414 341 338 338
query49 1213 302 303 302
query50 770 384 374 374
query51 4433 4298 4351 4298
query52 109 98 96 96
query53 409 302 304 302
query54 309 219 235 219
query55 84 85 79 79
query56 220 201 201 201
query57 1059 936 979 936
query58 221 192 195 192
query59 2347 2127 2142 2127
query60 254 220 231 220
query61 85 85 87 85
query62 602 379 374 374
query63 325 286 297 286
query64 6324 3000 3066 3000
query65 3291 3251 3227 3227
query66 1357 341 327 327
query67 14663 14346 14221 14221
query68 5142 547 554 547
query69 519 358 370 358
query70 1244 1206 1220 1206
query71 448 257 257 257
query72 6396 2808 2640 2640
query73 703 308 315 308
query74 6872 6571 6426 6426
query75 3217 2568 2566 2566
query76 3241 1144 1215 1144
query77 349 242 233 233
query78 9411 8802 8793 8793
query79 958 511 515 511
query80 511 375 356 356
query81 436 207 202 202
query82 164 84 82 82
query83 140 124 122 122
query84 221 81 77 77
query85 1024 354 349 349
query86 288 307 312 307
query87 3521 3295 3279 3279
query88 2754 2282 2282 2282
query89 431 358 357 357
query90 1946 167 170 167
query91 157 126 133 126
query92 54 49 51 49
query93 1011 519 496 496
query94 1140 184 182 182
query95 443 345 342 342
query96 574 262 262 262
query97 4445 4242 4303 4242
query98 228 202 197 197
query99 1053 715 747 715
Total cold run time: 268621 ms
Total hot run time: 176493 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1960921785
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961548303
<details>
<summary>TPC-H: <b>Total hot run time: 41011 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bd69447acb363a6e904f9949ffdf50f93c2ece8d, data reload: false
------ Round 1 ----------------------------------
q1 17638 5080 4901 4901
q2 2038 141 137 137
q3 10665 988 981 981
q4 4733 962 982 962
q5 7619 3134 3186 3134
q6 190 133 135 133
q7 1250 781 763 763
q8 9347 2033 2062 2033
q9 7523 6555 6531 6531
q10 8296 2671 2638 2638
q11 420 200 204 200
q12 820 330 326 326
q13 17965 3609 3615 3609
q14 305 262 253 253
q15 598 517 530 517
q16 474 400 432 400
q17 920 823 849 823
q18 7455 6801 6629 6629
q19 1552 1496 1488 1488
q20 547 277 272 272
q21 6787 3951 3935 3935
q22 867 346 348 346
Total cold run time: 108009 ms
Total hot run time: 41011 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4905 4900 4891 4891
q2 293 182 188 182
q3 3591 3546 3580 3546
q4 2534 2535 2538 2535
q5 5717 5742 5722 5722
q6 213 128 127 127
q7 2282 1683 1652 1652
q8 2983 3046 3050 3046
q9 8637 8690 8628 8628
q10 6807 4214 4237 4214
q11 518 399 398 398
q12 784 561 553 553
q13 4383 3411 3395 3395
q14 267 232 233 232
q15 631 507 516 507
q16 490 458 445 445
q17 1981 1589 1601 1589
q18 8269 7704 7562 7562
q19 1629 1640 1625 1625
q20 2123 1828 1806 1806
q21 6559 6160 6198 6160
q22 577 495 520 495
Total cold run time: 66173 ms
Total hot run time: 59310 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #31328:
URL: https://github.com/apache/doris/pull/31328#issuecomment-1961566030
<details>
<summary>TPC-DS: <b>Total hot run time: 176952 ms</b></summary>
```
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bd69447acb363a6e904f9949ffdf50f93c2ece8d, data reload: false
query1 934 350 347 347
query2 6507 1682 1757 1682
query3 6689 211 204 204
query4 23188 21211 21071 21071
query5 4245 390 374 374
query6 257 177 176 176
query7 4612 296 299 296
query8 249 190 202 190
query9 8450 2849 2858 2849
query10 420 228 223 223
query11 15087 14460 14430 14430
query12 138 80 82 80
query13 1705 424 414 414
query14 9084 7606 7664 7606
query15 215 187 185 185
query16 7352 248 249 248
query17 1413 550 531 531
query18 1949 278 259 259
query19 201 147 153 147
query20 88 81 85 81
query21 188 129 128 128
query22 5016 4886 4984 4886
query23 32418 31503 31476 31476
query24 12683 3375 3471 3375
query25 640 359 365 359
query26 1895 155 158 155
query27 3055 310 318 310
query28 6633 1869 1859 1859
query29 1224 650 641 641
query30 283 136 150 136
query31 951 747 764 747
query32 95 62 58 58
query33 743 235 233 233
query34 1078 495 509 495
query35 931 831 832 831
query36 1000 899 900 899
query37 182 62 66 62
query38 3313 3189 3231 3189
query39 1374 1317 1320 1317
query40 281 105 105 105
query41 39 37 35 35
query42 100 103 100 100
query43 472 439 455 439
query44 1071 692 710 692
query45 200 183 175 175
query46 1064 803 764 764
query47 1650 1545 1548 1545
query48 419 345 348 345
query49 1226 314 309 309
query50 770 383 380 380
query51 4430 4286 4293 4286
query52 109 95 98 95
query53 395 316 307 307
query54 292 220 228 220
query55 83 82 79 79
query56 229 208 205 205
query57 1053 975 959 959
query58 222 198 208 198
query59 2289 2087 2260 2087
query60 235 228 224 224
query61 88 87 90 87
query62 593 386 375 375
query63 346 308 298 298
query64 6356 3073 3137 3073
query65 3277 3260 3222 3222
query66 1391 332 322 322
query67 14705 14550 14340 14340
query68 4076 565 587 565
query69 477 358 353 353
query70 1294 1195 1230 1195
query71 352 250 256 250
query72 6018 2810 2636 2636
query73 693 324 321 321
query74 6892 6428 6482 6428
query75 3147 2575 2542 2542
query76 2387 1116 1187 1116
query77 341 248 246 246
query78 9366 8751 8732 8732
query79 977 526 514 514
query80 544 364 364 364
query81 438 207 207 207
query82 167 84 84 84
query83 144 124 123 123
query84 231 81 79 79
query85 1067 363 350 350
query86 293 305 303 303
query87 3445 3262 3252 3252
query88 2759 2330 2340 2330
query89 452 376 369 369
query90 2090 166 168 166
query91 151 134 132 132
query92 53 51 46 46
query93 1015 510 506 506
query94 1210 179 182 179
query95 442 339 342 339
query96 573 267 271 267
query97 4456 4288 4228 4228
query98 235 205 199 199
query99 1094 723 716 716
Total cold run time: 266749 ms
Total hot run time: 176952 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](file scan) Improve parallel tasks if ignore data distribution [doris]
Posted by "yiguolei (via GitHub)" <gi...@apache.org>.
yiguolei merged PR #31328:
URL: https://github.com/apache/doris/pull/31328
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org