You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "zclllyybb (via GitHub)" <gi...@apache.org> on 2023/12/19 16:03:16 UTC

[PR] [Enhancement](auto-partition) change the behaviour when insert overwrite an auto partition table [doris]

zclllyybb opened a new pull request, #28683:
URL: https://github.com/apache/doris/pull/28683

   ## Proposed changes
   
   Issue Number: close #xxx
   
   If we specific target partition(s) when inserting overwrite an auto partition table,
   before:
   could create new partition 
   now:
   behalf just like non-auto partition table
   
   ## Further comments
   
   If this is a relatively large or complex change, kick off the discussion at [dev@doris.apache.org](mailto:dev@doris.apache.org) by explaining why you chose the solution you did and what alternatives you considered, etc...
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](auto-partition) change the behaviour when insert overwrite an auto partition table [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28683:
URL: https://github.com/apache/doris/pull/28683#issuecomment-1864015859

   PR approved by anyone and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](auto-partition) change the behaviour when insert overwrite an auto partition table [doris]

Posted by "zclllyybb (via GitHub)" <gi...@apache.org>.
zclllyybb commented on PR #28683:
URL: https://github.com/apache/doris/pull/28683#issuecomment-1863043226

   run buildall


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](auto-partition) change the behaviour when insert overwrite an auto partition table [doris]

Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #28683:
URL: https://github.com/apache/doris/pull/28683#issuecomment-1864015816

   PR approved by at least one committer and no changes requested.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](auto-partition) change the behaviour when insert overwrite an auto partition table [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28683:
URL: https://github.com/apache/doris/pull/28683#issuecomment-1863110048

   
   TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
   ```
   Tpch sf100 test result on commit e57b86fe56b372696aaeb57eede736f5cc440435, data reload: false
   
   run tpch-sf100 query with default conf and session variables
   q1	4654	4421	4434	4421
   q2	358	157	158	157
   q3	1473	1241	1207	1207
   q4	1120	912	901	901
   q5	3160	3155	3145	3145
   q6	249	130	129	129
   q7	994	493	500	493
   q8	2217	2195	2203	2195
   q9	6687	6688	6689	6688
   q10	3213	3252	3280	3252
   q11	303	187	186	186
   q12	355	209	208	208
   q13	4591	3772	3865	3772
   q14	239	215	210	210
   q15	561	529	527	527
   q16	441	385	389	385
   q17	1005	584	543	543
   q18	7160	7021	6974	6974
   q19	1508	1417	1454	1417
   q20	530	328	293	293
   q21	3042	2634	2658	2634
   q22	345	273	286	273
   Total cold run time: 44205 ms
   Total hot run time: 40010 ms
   
   run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
   q1	4346	4331	4297	4297
   q2	269	167	174	167
   q3	3523	3516	3500	3500
   q4	2376	2370	2369	2369
   q5	5758	5752	5739	5739
   q6	238	123	124	123
   q7	2377	1887	1903	1887
   q8	3527	3518	3515	3515
   q9	9018	8946	9000	8946
   q10	3921	4041	3983	3983
   q11	478	361	368	361
   q12	772	593	606	593
   q13	4311	3575	3580	3575
   q14	286	246	249	246
   q15	575	526	522	522
   q16	511	450	464	450
   q17	1892	1871	1855	1855
   q18	8651	8234	8258	8234
   q19	1737	1762	1778	1762
   q20	2259	1947	1925	1925
   q21	6482	6201	6175	6175
   q22	502	436	407	407
   Total cold run time: 63809 ms
   Total hot run time: 60631 ms
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](auto-partition) change the behaviour when insert overwrite an auto partition table [doris]

Posted by "zhangstar333 (via GitHub)" <gi...@apache.org>.
zhangstar333 merged PR #28683:
URL: https://github.com/apache/doris/pull/28683


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org


Re: [PR] [Enhancement](auto-partition) change the behaviour when insert overwrite an auto partition table [doris]

Posted by "doris-robot (via GitHub)" <gi...@apache.org>.
doris-robot commented on PR #28683:
URL: https://github.com/apache/doris/pull/28683#issuecomment-1863114812

   (From new machine)TeamCity pipeline, clickbench performance test result:
    the sum of best hot time: 44.22 seconds
    stream load tsv:          568 seconds loaded 74807831229 Bytes, about 125 MB/s
    stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
    stream load orc:          66 seconds loaded 1101869774 Bytes, about 15 MB/s
    stream load parquet:          32 seconds loaded 861443392 Bytes, about 25 MB/s
    insert into select:          28.9 seconds inserted 10000000 Rows, about 346K ops/s
    storage size: 17183789743 Bytes


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org