You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "jackwener (via GitHub)" <gi...@apache.org> on 2023/12/26 13:05:39 UTC
[PR] [fix](Nereids): merge Offset in Limit Translator [doris]
jackwener opened a new pull request, #29100:
URL: https://github.com/apache/doris/pull/29100
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869963195
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870873158
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.38 seconds
stream load tsv: 568 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17184214806 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870022571
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870875376
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit 25842829f1c98342448ad260f23ab872a0ccb120, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5000 4643 4667 4643
q2 366 148 159 148
q3 1469 1311 1222 1222
q4 1129 941 897 897
q5 3186 3175 3181 3175
q6 251 125 125 125
q7 1043 488 503 488
q8 2285 2256 2264 2256
q9 6728 6706 6725 6706
q10 3187 3265 3278 3265
q11 323 224 198 198
q12 348 203 211 203
q13 4158 3402 3424 3402
q14 239 212 217 212
q15 575 523 525 523
q16 446 391 380 380
q17 1060 756 530 530
q18 7094 6838 6791 6791
q19 1628 1641 1647 1641
q20 623 314 329 314
q21 3145 2709 2689 2689
q22 366 299 313 299
Total cold run time: 44649 ms
Total hot run time: 40107 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4587 4560 4551 4551
q2 272 168 170 168
q3 3375 3373 3366 3366
q4 2229 2207 2207 2207
q5 5718 5714 5717 5714
q6 242 117 117 117
q7 2393 1863 1897 1863
q8 3630 3620 3617 3617
q9 9085 8979 9020 8979
q10 3781 3901 3892 3892
q11 491 374 365 365
q12 773 609 599 599
q13 3903 3181 3193 3181
q14 291 248 249 248
q15 563 520 509 509
q16 514 452 454 452
q17 1982 1980 1942 1942
q18 8678 8245 8329 8245
q19 1743 1796 1782 1782
q20 2256 1936 1923 1923
q21 6147 5752 5774 5752
q22 552 455 465 455
Total cold run time: 63205 ms
Total hot run time: 59927 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869872567
run p0
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870853945
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870900177
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869552743
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit f497146d7496e6ff8bbce682b8b6c2931c35fe2d, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4813 4477 4498 4477
q2 380 173 158 158
q3 1493 1364 1207 1207
q4 1140 957 920 920
q5 3177 3176 3142 3142
q6 260 133 134 133
q7 1001 501 498 498
q8 2280 2275 2251 2251
q9 6743 6698 6675 6675
q10 3209 3311 3308 3308
q11 334 210 209 209
q12 357 216 213 213
q13 4522 3816 3752 3752
q14 241 217 212 212
q15 579 529 516 516
q16 441 377 381 377
q17 1050 757 591 591
q18 7023 6762 6913 6762
q19 1575 1598 1583 1583
q20 587 341 290 290
q21 3226 2737 2767 2737
q22 364 306 309 306
Total cold run time: 44795 ms
Total hot run time: 40317 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4445 4436 4438 4436
q2 273 170 169 169
q3 3514 3514 3500 3500
q4 2433 2415 2424 2415
q5 5769 5730 5719 5719
q6 254 129 125 125
q7 2410 1859 1876 1859
q8 3610 3616 3621 3616
q9 9046 8961 9025 8961
q10 3919 4020 4023 4020
q11 500 371 362 362
q12 783 614 615 614
q13 4298 3559 3551 3551
q14 288 260 256 256
q15 563 515 524 515
q16 496 468 465 465
q17 1978 1970 1963 1963
q18 8612 8042 8190 8042
q19 1826 1828 1829 1828
q20 2262 1959 1938 1938
q21 6659 6245 6230 6230
q22 540 477 469 469
Total cold run time: 64478 ms
Total hot run time: 61053 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869999997
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869559068
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.8 seconds
stream load tsv: 565 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 20.7 seconds inserted 10000000 Rows, about 483K ops/s
storage size: 17183694903 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870124174
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.67 seconds
stream load tsv: 566 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17183853664 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870148361
TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
```
Tpch sf100 test result on commit c9b8c6a57bac56e42aa1908ddbfbc0188c718bad, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5138 4838 4818 4818
q2 382 152 168 152
q3 1548 1347 1278 1278
q4 1207 1027 917 917
q5 3267 3266 3287 3266
q6 280 129 129 129
q7 1100 569 499 499
q8 2382 2415 2419 2415
q9 6895 6928 6885 6885
q10 3228 3318 3318 3318
q11 351 218 212 212
q12 388 206 210 206
q13 4234 3465 3430 3430
q14 242 218 210 210
q15 580 510 519 510
q16 449 390 390 390
q17 1060 767 620 620
q18 7078 6670 6810 6670
q19 1771 1814 1781 1781
q20 560 300 295 295
q21 3350 2849 2855 2849
q22 376 298 306 298
Total cold run time: 45866 ms
Total hot run time: 41148 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4760 4737 4692 4692
q2 301 165 167 165
q3 3440 3484 3407 3407
q4 2307 2286 2272 2272
q5 5824 5827 5825 5825
q6 268 122 121 121
q7 2407 1861 1880 1861
q8 3764 3761 3769 3761
q9 9057 8991 9031 8991
q10 3838 3975 3949 3949
q11 506 375 369 369
q12 789 602 597 597
q13 3995 3238 3173 3173
q14 286 247 246 246
q15 589 522 525 522
q16 491 468 461 461
q17 2083 2021 2023 2021
q18 8704 8341 8232 8232
q19 1924 1916 1937 1916
q20 2282 1937 1940 1937
q21 6328 5933 5922 5922
q22 543 495 447 447
Total cold run time: 64486 ms
Total hot run time: 60887 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869917172
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869981318
run p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870899066
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener merged PR #29100:
URL: https://github.com/apache/doris/pull/29100
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1870089022
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869538349
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](Nereids): merge Offset in Limit Translator [doris]
Posted by "jackwener (via GitHub)" <gi...@apache.org>.
jackwener commented on PR #29100:
URL: https://github.com/apache/doris/pull/29100#issuecomment-1869873098
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org