You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Mryange (via GitHub)" <gi...@apache.org> on 2023/12/15 06:05:34 UTC
[PR] [pipelineX](profile) make dep time merge [doris]
Mryange opened a new pull request, #28458:
URL: https://github.com/apache/doris/pull/28458
## Proposed changes
```
HASH_JOIN_OPERATOR (id=2194):
- PlanInfo
- join op: INNER JOIN(PARTITIONED)[]
- equal join conjunct: c_customer_sk = ctr_customer_sk
- runtime filters: RF002[bloom] <- ctr_customer_sk(143414/131072/1048576)
- cardinality=144,624
- vec output tuple id: 22
- vIntermediate tuple ids: 21
- hash output slot ids: 132
- BlocksProduced: sum 1.89K (1890), avg 236, max 239, min 235
- CloseTime: avg 13.499us, max 17.966us, min 10.834us
- ExecTime: avg 110.215ms, max 126.396ms, min 99.841ms
- OpenTime: avg 126.161us, max 206.154us, min 50.523us
- ProbeRows: sum 4.0M (4000000), avg 500.0K (500000), max 500.0K (500000), min 500.0K (500000)
- ProjectionTime: avg 4.722ms, max 5.329ms, min 4.209ms
- RowsProduced: sum 4.732096M (4732096), avg 591.512K (591512), max 598.464K (598464), min 585.216K (585216)
- WaitForDependency[HashJoinProbeDependency]Time: avg 1s370ms, max 1s373ms, min 1s368ms
EXCHANGE_OPERATOR (id=2146):
- PlanInfo
- offset: 0
- BlocksProduced: sum 969, avg 121, max 123, min 120
- CloseTime: avg 9.399us, max 14.61us, min 6.874us
- ExecTime: avg 881.577us, max 1.16ms, min 801.197us
- OpenTime: avg 58.196us, max 61.881us, min 54.785us
- ProjectionTime: avg 0ns, max 0ns, min 0ns
- RowsProduced: sum 4.0M (4000000), avg 500.0K (500000), max 500.0K (500000), min 500.0K (500000)
- WaitForDependency[AndDependency]Time: avg 0ns, max 0ns, min 0ns
- WaitForData0: avg 935.118ms, max 935.567ms, min 934.531ms
```
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](profile) make dep time merge [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28458:
URL: https://github.com/apache/doris/pull/28458#issuecomment-1859441774
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](profile) make dep time merge [doris]
Posted by "Mryange (via GitHub)" <gi...@apache.org>.
Mryange commented on PR #28458:
URL: https://github.com/apache/doris/pull/28458#issuecomment-1857331363
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](profile) make dep time merge [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28458:
URL: https://github.com/apache/doris/pull/28458#issuecomment-1859441801
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](profile) make dep time merge [doris]
Posted by "Gabriel39 (via GitHub)" <gi...@apache.org>.
Gabriel39 merged PR #28458:
URL: https://github.com/apache/doris/pull/28458
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](profile) make dep time merge [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28458:
URL: https://github.com/apache/doris/pull/28458#issuecomment-1857406155
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 33154361b77bd7d9eedcb613300a164453095dc6, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4796 4510 4569 4510
q2 372 144 159 144
q3 1478 1276 1213 1213
q4 1113 924 861 861
q5 3197 3170 3197 3170
q6 249 128 128 128
q7 1016 491 480 480
q8 2219 2208 2211 2208
q9 6724 6727 6696 6696
q10 3217 3265 3288 3265
q11 325 202 208 202
q12 360 211 207 207
q13 4579 3837 3835 3835
q14 250 209 206 206
q15 565 522 517 517
q16 441 385 390 385
q17 1042 651 628 628
q18 7057 6833 6748 6748
q19 1524 1463 1347 1347
q20 549 312 294 294
q21 3111 2673 2714 2673
q22 351 281 285 281
Total cold run time: 44535 ms
Total hot run time: 39998 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4511 4449 4458 4449
q2 268 163 173 163
q3 3524 3532 3516 3516
q4 2403 2393 2400 2393
q5 5773 5774 5767 5767
q6 245 124 123 123
q7 2371 1879 1851 1851
q8 3545 3549 3556 3549
q9 9094 8998 9022 8998
q10 3934 4023 4026 4023
q11 501 387 367 367
q12 770 591 604 591
q13 4303 3573 3564 3564
q14 287 261 245 245
q15 580 515 518 515
q16 505 445 482 445
q17 1886 1845 1882 1845
q18 8447 7978 8164 7978
q19 1750 1777 1769 1769
q20 2265 1945 1942 1942
q21 6526 6188 6171 6171
q22 499 416 412 412
Total cold run time: 63987 ms
Total hot run time: 60676 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](profile) make dep time merge [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28458:
URL: https://github.com/apache/doris/pull/28458#issuecomment-1857335824
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [pipelineX](profile) make dep time merge [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28458:
URL: https://github.com/apache/doris/pull/28458#issuecomment-1857383044
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.72 seconds
stream load tsv: 580 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 33 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17219722675 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org