You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/05/14 10:05:42 UTC
[GitHub] [incubator-doris] WingsGo opened a new issue #3590: [Proposal]Support dynamic buckets setting in dynamica parition
WingsGo opened a new issue #3590:
URL: https://github.com/apache/incubator-doris/issues/3590
**Is your feature request related to a problem? Please describe.**
When user create a dynamic partition table, they will sets a lot of parameters, and the table's daily datas may increase or decrease over time.
In order to provide more convient usage to users, we can introudce a strategy to dynamic setting partitions buckets for users and keep the default behavior, if they don't want to set the buckets num, they can choose our strategy to dynamic setting buckets, I will investigate other OLAP engine like `ES` to introduce dynamic setting buckets to Doris.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] marising commented on issue #3590: [Proposal]Support dynamic buckets setting in dynamica parition
Posted by GitBox <gi...@apache.org>.
marising commented on issue #3590:
URL: https://github.com/apache/incubator-doris/issues/3590#issuecomment-633025084
This is very useful for most users, with a higher number of users unable to set the correct number of buckets.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] WingsGo commented on issue #3590: [Proposal]Support dynamic buckets setting in dynamica parition
Posted by GitBox <gi...@apache.org>.
WingsGo commented on issue #3590:
URL: https://github.com/apache/incubator-doris/issues/3590#issuecomment-640530993
Hi, @morningman @kangkaisen The problem's nature is a math model to predicate the trends in data change, but a good model is get by data, we cannot give a unify model to predicate all situation,.So I decide to provide a simple model with simple sequential average method.And expose the interface, If we have another strategy, we can implement it and choose different strategy to adjust different situation, and I will give a param named `dynamic_partition.buckets_strategy` , if it is not specified, I will use the default simple mode to predicate the buckets to get a relative better buckets.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] kangkaisen commented on issue #3590: [Proposal]Support dynamic buckets setting in dynamica parition
Posted by GitBox <gi...@apache.org>.
kangkaisen commented on issue #3590:
URL: https://github.com/apache/incubator-doris/issues/3590#issuecomment-640552425
@WingsGo Yes, the strategy should be Pluggable. I think this issue is like HBase (Tikv) region auto merge and split, Kylin(Druid) segment merge. If we know the best size for one table(which could be configured), we could auto split and merge Doris partitions by tmp partition mechanism.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org