incubator-doris [Disk Balance] How to balance tablet among disks in some BE.

qrjkbowd  于 2022-04-22  发布在  Java
关注(0)|答案(3)|浏览(270)

Is your feature request related to a problem? Please describe.

The current balancing strategy is only used for data balancing between different BEs. But it cannot handle the data balance between different disks on the same BE. We often find that the usage of different disks on a BE varies greatly.

#4373 try to use "two random choices algorithm to try to choose a more reasonable disk.
But for existing data, we need a way to migrate and balance data between disks.

Describe the solution you'd like

We can use storage medium migration task to perform tablet migration.
This is a simple and feasible solution. We can try to support this way first.

But this way needs to lock the tablet during migration to prevent operations such as writing.
So it is a feasible but not elegant solution. We can try to implement this function in a similar way
to schema change in the future.

9lowa7mx

9lowa7mx1#

We are doing related attempts of tablet migration between disks on the same machine. Assume that all tablets of the same partition in the same table occupy similar disk space. When migrating tablets, try to ensure that tablets of the same partition in the same table are evenly distributed on different disks.

rqdpfwrv

rqdpfwrv2#

We are doing related attempts of tablet migration between disks on the same machine. Assume that all tablets of the same partition in the same table occupy similar disk space. When migrating tablets, try to ensure that tablets of the same partition in the same table are evenly distributed on different disks.

Do you have any idea about how to migrate tablet between disk? Using this migration task or some new method?

kognpnkq

kognpnkq3#

Do you have any idea about how to migrate tablet between disk? Using this migration task or some new method?

The method of migrating tablet between disks that we use now is based on storage medium migration tasks that you mentioned above.

相关问题