[I] [Feature] refactor colocate [doris]

["hqx871 (via GitHub)" <gi...@apache.org>]

hqx871 opened a new issue, #63584:
URL: https://github.com/apache/doris/issues/63584

   ### Search before asking
   
   - [x] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Description
   
   当前colocate的限制：
   1. 多租户部署时副本冗余：例如租户A需要JOIN租户B的表，租户C需要JOIN租户B的表，但是租户A不需要JOIN租户C的表，理论上我们只需要在租户A/C的机器上增加租户B的表的副本，租户A/C就可以在自己的机器上做ColocateJoin，但是当前的Colocate实现要求租户A/B/C的表必须在A/B/C三个租户的机器上都放置副本，导致副本冗余。
   2. 分桶数限制：当前colocate的实现要求两个表的分桶数必须相同才能做ColocateJoin，当JOIN的表的数量级差别比较大时，难以设置统一的分桶数。
   
   
   方案：
   1.  支持租户粒度的colcoate，避免副本冗余问题。同时，单个租户的colocate失效不影响其他租户。
   2. 支持分桶数为倍数关系的colocate
   
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [x] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org

Re: [I] [Feature] refactor colocate [doris]

["MilanTyagi2004 (via GitHub)" <gi...@apache.org>]

MilanTyagi2004 commented on issue #63584:
URL: https://github.com/apache/doris/issues/63584#issuecomment-4629754134

   Hi @hqx871,
   
   I'd like to work on this feature and contribute a PR for it. I have reviewed the issue description and understand the requirements around tenant-level colocate groups and supporting bucket counts with multiple relationships.
   
   If possible, could you please assign this issue to me?
   
   Thank you.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org