You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "mymeiyi (via GitHub)" <gi...@apache.org> on 2023/11/09 07:30:07 UTC
[PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
mymeiyi opened a new pull request, #26652:
URL: https://github.com/apache/doris/pull/26652
…able
## Proposed changes
As the title, fix write sequence and delete sign column for unique table with group commit load, and add some regressions.
## Further comments
If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #26652:
URL: https://github.com/apache/doris/pull/26652#issuecomment-1803350765
(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.54 seconds
stream load tsv: 560 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 34 seconds loaded 861443392 Bytes, about 24 MB/s
insert into select: 29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size: 17162531476 Bytes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #26652:
URL: https://github.com/apache/doris/pull/26652#issuecomment-1803931334
PR approved by anyone and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "dataroaring (via GitHub)" <gi...@apache.org>.
dataroaring merged PR #26652:
URL: https://github.com/apache/doris/pull/26652
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "mymeiyi (via GitHub)" <gi...@apache.org>.
mymeiyi commented on PR #26652:
URL: https://github.com/apache/doris/pull/26652#issuecomment-1803296908
run buildall
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #26652:
URL: https://github.com/apache/doris/pull/26652#issuecomment-1803337243
<details>
<summary>TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'</summary>
```
Tpch sf100 test result on commit de22ac6f8afe0ee35cdc05799ccd6c083e1562f1, data reload: false
run tpch-sf100 query with default conf and session variables
q1 5237 5092 5096 5092
q2 369 224 231 224
q3 2055 2011 2097 2011
q4 1468 1432 1443 1432
q5 4105 4133 4097 4097
q6 250 132 135 132
q7 2078 1618 1617 1617
q8 2732 2712 2734 2712
q9 10691 10201 10155 10155
q10 3491 3572 3581 3572
q11 365 257 244 244
q12 449 292 293 292
q13 4494 4145 4150 4145
q14 318 287 282 282
q15 620 559 589 559
q16 703 624 601 601
q17 1124 1074 1073 1073
q18 7926 7533 7563 7533
q19 1682 1678 1664 1664
q20 590 366 345 345
q21 4894 4521 4554 4521
q22 536 441 444 441
Total cold run time: 56177 ms
Total hot run time: 52744 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1 4869 5103 4918 4918
q2 384 234 248 234
q3 4008 3959 3975 3959
q4 2782 2794 2748 2748
q5 6511 6414 6420 6414
q6 236 133 130 130
q7 3144 2709 2746 2709
q8 4792 4718 4681 4681
q9 17775 17503 17675 17503
q10 4139 4213 4196 4196
q11 752 669 633 633
q12 1039 834 846 834
q13 4300 3939 3872 3872
q14 369 345 353 345
q15 617 523 514 514
q16 780 717 707 707
q17 3895 3894 4015 3894
q18 9476 9308 9590 9308
q19 1774 1746 1778 1746
q20 2361 2075 2030 2030
q21 8908 8732 8695 8695
q22 976 910 864 864
Total cold run time: 83887 ms
Total hot run time: 80934 ms
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "mymeiyi (via GitHub)" <gi...@apache.org>.
mymeiyi commented on PR #26652:
URL: https://github.com/apache/doris/pull/26652#issuecomment-1803390978
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "mymeiyi (via GitHub)" <gi...@apache.org>.
mymeiyi commented on PR #26652:
URL: https://github.com/apache/doris/pull/26652#issuecomment-1803442868
run pipelinex_p0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [fix](group commit) Group commit support sequence column for unique t… [doris]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #26652:
URL: https://github.com/apache/doris/pull/26652#issuecomment-1803931241
PR approved by at least one committer and no changes requested.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org