Is your feature request related to a problem? Please describe.
The current balancing strategy is only used for data balancing between different BEs. But it cannot handle the data balance between different disks on the same BE. We often find that the usage of different disks on a BE varies greatly.
#4373 try to use "two random choices
algorithm to try to choose a more reasonable disk.
But for existing data, we need a way to migrate and balance data between disks.
Describe the solution you'd like
We can use storage medium migration task
to perform tablet migration.
This is a simple and feasible solution. We can try to support this way first.
But this way needs to lock the tablet during migration to prevent operations such as writing.
So it is a feasible but not elegant solution. We can try to implement this function in a similar way
to schema change in the future.
3条答案
按热度按时间9lowa7mx1#
We are doing related attempts of tablet migration between disks on the same machine. Assume that all tablets of the same partition in the same table occupy similar disk space. When migrating tablets, try to ensure that tablets of the same partition in the same table are evenly distributed on different disks.
rqdpfwrv2#
We are doing related attempts of tablet migration between disks on the same machine. Assume that all tablets of the same partition in the same table occupy similar disk space. When migrating tablets, try to ensure that tablets of the same partition in the same table are evenly distributed on different disks.
Do you have any idea about how to migrate tablet between disk? Using this migration task or some new method?
kognpnkq3#
Do you have any idea about how to migrate tablet between disk? Using this migration task or some new method?
The method of migrating tablet between disks that we use now is based on storage medium migration tasks that you mentioned above.