You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "yujun777 (via GitHub)" <gi...@apache.org> on 2023/12/12 07:27:06 UTC
[PR] [improvement](transaction) reduce publish txn fail log [doris]
yujun777 opened a new pull request, #28277:
URL: https://github.com/apache/doris/pull/28277
for a single txn, if publish it failed, then print log every 5min (Config.publish_fail_log_interval_second)
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](transaction) reduce publish txn fail log [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28277:
URL: https://github.com/apache/doris/pull/28277#issuecomment-1851901304
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](transaction) reduce publish txn fail log [doris]
Posted by "yujun777 (via GitHub)" <gi...@apache.org>.
yujun777 commented on PR #28277:
URL: https://github.com/apache/doris/pull/28277#issuecomment-1862448028
run arm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](transaction) reduce publish txn fail log [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #28277:
URL: https://github.com/apache/doris/pull/28277
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](transaction) reduce publish txn fail log [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28277:
URL: https://github.com/apache/doris/pull/28277#issuecomment-1851476552
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit 12033c72dc87b0ed300fcda3040965a585a6619c, data reload: false
run tpch-sf100 query with default conf and session variables
q1 4631 4432 4431 4431
q2 359 156 159 156
q3 1478 1238 1217 1217
q4 1107 964 880 880
q5 3139 3134 3125 3125
q6 248 129 129 129
q7 976 485 471 471
q8 2222 2222 2179 2179
q9 6640 6681 6680 6680
q10 3222 3258 3255 3255
q11 325 207 204 204
q12 347 209 203 203
q13 4607 3794 3843 3794
q14 244 207 212 207
q15 559 523 525 523
q16 450 388 392 388
q17 996 593 547 547
q18 7542 7571 7043 7043
q19 1515 1279 1514 1279
q20 1170 285 306 285
q21 3065 2609 2694 2609
q22 352 283 289 283
Total cold run time: 45194 ms
Total hot run time: 39888 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4438 4371 4387 4371
q2 266 161 175 161
q3 3558 3538 3536 3536
q4 2393 2374 2368 2368
q5 5766 5740 5769 5740
q6 243 122 123 122
q7 2400 1918 1849 1849
q8 3513 3536 3523 3523
q9 9109 9013 9058 9013
q10 3906 3987 3973 3973
q11 518 378 387 378
q12 777 601 606 601
q13 4277 3562 3542 3542
q14 282 259 261 259
q15 570 513 515 513
q16 502 460 477 460
q17 1904 1878 1853 1853
q18 8756 8229 8680 8229
q19 1778 1749 1776 1749
q20 2246 1944 1934 1934
q21 6536 6371 6164 6164
q22 498 448 426 426
Total cold run time: 64236 ms
Total hot run time: 60764 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](transaction) reduce publish txn fail log [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28277:
URL: https://github.com/apache/doris/pull/28277#issuecomment-1862465244
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](transaction) reduce publish txn fail log [doris]
Posted by "yujun777 (via GitHub)" <gi...@apache.org>.
yujun777 commented on PR #28277:
URL: https://github.com/apache/doris/pull/28277#issuecomment-1851437018
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improvement](transaction) reduce publish txn fail log [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28277:
URL: https://github.com/apache/doris/pull/28277#issuecomment-1851482773
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.81 seconds
stream load tsv: 577 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.3 seconds inserted 10000000 Rows, about 353K ops/s
storage size: 17219635444 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org