You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2020/08/27 15:33:04 UTC
[GitHub] [incubator-doris] morningman opened a new issue #4476: [Disk Balance] How to balance tablet among disks in some BE.
morningman opened a new issue #4476:
URL: https://github.com/apache/incubator-doris/issues/4476
**Is your feature request related to a problem? Please describe.**
The current balancing strategy is only used for data balancing between different BEs. But it cannot handle the data balance between different disks on the same BE. We often find that the usage of different disks on a BE varies greatly.
#4373 try to use `"two random choices` algorithm to try to choose a more reasonable disk.
But for existing data, we need a way to migrate and balance data between disks.
**Describe the solution you'd like**
We can use `storage medium migration task` to perform tablet migration.
This is a simple and feasible solution. We can try to support this way first.
But this way needs to lock the tablet during migration to prevent operations such as writing.
So it is a feasible but not elegant solution. We can try to implement this function in a similar way
to schema change in the future.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] weizuo93 edited a comment on issue #4476: [Disk Balance] How to balance tablet among disks in some BE.
Posted by GitBox <gi...@apache.org>.
weizuo93 edited a comment on issue #4476:
URL: https://github.com/apache/incubator-doris/issues/4476#issuecomment-682523909
> Do you have any idea about how to migrate tablet between disk? Using this migration task or some new method?
The method of migrating tablet between disks that we use now is based on storage medium migration tasks that you mentioned above.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #4476: [Disk Balance] How to balance tablet among disks in some BE.
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #4476:
URL: https://github.com/apache/incubator-doris/issues/4476#issuecomment-682333769
> We are doing related attempts of tablet migration between disks on the same machine. Assume that all tablets of the same partition in the same table occupy similar disk space. When migrating tablets, try to ensure that tablets of the same partition in the same table are evenly distributed on different disks.
Do you have any idea about how to migrate tablet between disk? Using this migration task or some new method?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] weizuo93 commented on issue #4476: [Disk Balance] How to balance tablet among disks in some BE.
Posted by GitBox <gi...@apache.org>.
weizuo93 commented on issue #4476:
URL: https://github.com/apache/incubator-doris/issues/4476#issuecomment-682305882
We are doing related attempts of tablet migration between disks on the same machine. Assume that all tablets of the same partition in the same table occupy similar disk space. When migrating tablets, try to ensure that tablets of the same partition in the same table are evenly distributed on different disks.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] weizuo93 commented on issue #4476: [Disk Balance] How to balance tablet among disks in some BE.
Posted by GitBox <gi...@apache.org>.
weizuo93 commented on issue #4476:
URL: https://github.com/apache/incubator-doris/issues/4476#issuecomment-682523909
> Do you have any idea about how to migrate tablet between disk? Using this migration task or some new method?
The method of migrating tablet between disks that we use now is based on storage medium migration tasks as you mentioned above.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org