You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "hello-stephen (via GitHub)" <gi...@apache.org> on 2023/12/13 07:02:53 UTC
[PR] investigate master tpch [doris]
hello-stephen opened a new pull request, #28330:
URL: https://github.com/apache/doris/pull/28330
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] investigate master tpch [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28330:
URL: https://github.com/apache/doris/pull/28330#issuecomment-1853498357
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.13 seconds
stream load tsv: 586 seconds loaded 74807831229 Bytes, about 121 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.4 seconds inserted 10000000 Rows, about 340K ops/s
storage size: 17224246264 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] investigate master tpch [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28330:
URL: https://github.com/apache/doris/pull/28330#issuecomment-1853492550
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 75db69e24abadfe7b40616f71093b741970f6a9e, data reload: false
run tpch-sf100 query with default conf and session variables
q1 48128 31820 31842 31820
q2 379 135 138 135
q3 1552 1257 1183 1183
q4 1113 937 873 873
q5 3207 3411 3201 3201
q6 266 149 140 140
q7 977 508 488 488
q8 2188 2268 2202 2202
q9 6938 6944 7034 6944
q10 3277 3338 3296 3296
q11 331 212 222 212
q12 355 212 206 206
q13 4599 3900 3899 3899
q14 421 319 320 319
q15 779 1306 1325 1306
q16 448 389 394 389
q17 1028 559 552 552
q18 8143 7065 6979 6979
q19 1514 1315 1490 1315
q20 558 935 284 284
q21 3111 2690 2685 2685
q22 354 292 291 291
Total cold run time: 89666 ms
Total hot run time: 68719 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 30797 31847 31818 31818
q2 271 168 177 168
q3 3660 3647 3636 3636
q4 2409 2383 2379 2379
q5 5811 5796 5829 5796
q6 243 133 131 131
q7 3041 3403 3382 3382
q8 3539 3558 3552 3552
q9 9259 9210 9124 9124
q10 3969 4073 4071 4071
q11 804 926 1358 926
q12 772 602 596 596
q13 4316 3556 3564 3556
q14 505 441 445 441
q15 1101 1344 1327 1327
q16 514 473 476 473
q17 1872 1855 1933 1855
q18 8912 8090 8252 8090
q19 1775 1769 1776 1769
q20 2931 2571 2624 2571
q21 6614 6219 6221 6219
q22 506 428 434 428
Total cold run time: 93621 ms
Total hot run time: 92308 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] investigate master tpch [doris]
Posted by "hello-stephen (via GitHub)" <gi...@apache.org>.
hello-stephen closed pull request #28330: investigate master tpch
URL: https://github.com/apache/doris/pull/28330
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] investigate master tpch [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28330:
URL: https://github.com/apache/doris/pull/28330#issuecomment-1853590514
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.69 seconds
stream load tsv: 580 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size: 17219779267 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] investigate master tpch [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28330:
URL: https://github.com/apache/doris/pull/28330#issuecomment-1853377141
clang-tidy review says "All clean, LGTM! :+1:"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] investigate master tpch [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28330:
URL: https://github.com/apache/doris/pull/28330#issuecomment-1853755294
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 75db69e24abadfe7b40616f71093b741970f6a9e, data reload: false
run tpch-sf100 query with default conf and session variables
q1 48893 31821 31906 31821
q2 395 144 143 143
q3 1583 1244 1226 1226
q4 1112 925 874 874
q5 3215 3195 3193 3193
q6 257 142 150 142
q7 1007 498 477 477
q8 2163 2228 2186 2186
q9 6905 6897 6863 6863
q10 3237 3305 3298 3298
q11 339 202 215 202
q12 345 202 201 201
q13 4579 3824 3836 3824
q14 427 322 327 322
q15 766 1294 1324 1294
q16 440 382 390 382
q17 1019 567 570 567
q18 7437 7812 8686 7812
q19 1528 1309 1456 1309
q20 737 303 302 302
q21 3052 2695 2649 2649
q22 349 279 284 279
Total cold run time: 89785 ms
Total hot run time: 69366 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 30833 31839 31804 31804
q2 280 165 176 165
q3 3716 3618 3621 3618
q4 2398 2393 2375 2375
q5 5801 5799 5795 5795
q6 243 137 139 137
q7 3065 3387 3375 3375
q8 3533 3568 3547 3547
q9 9226 9213 9227 9213
q10 3981 4088 4068 4068
q11 805 915 1358 915
q12 761 584 622 584
q13 4295 3599 3568 3568
q14 453 426 435 426
q15 1162 1339 1328 1328
q16 511 462 473 462
q17 1888 1855 1856 1855
q18 8932 8358 8082 8082
q19 1775 1777 1753 1753
q20 2915 2609 2655 2609
q21 6538 6230 6145 6145
q22 497 432 423 423
Total cold run time: 93608 ms
Total hot run time: 92247 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org