database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

[fix](balance) fix partition rebalance bug (#7213)

Browse Source 
the number of replica on specified medium we get from `getReplicaNumByBeIdAndStorageMedium()` is
defined by table properties. But in fact there may not has SSD/HDD disk on this backend. 
So if we found that no SSD/HDD disk on this backend, set the replica number to 0,
but the partitionInfoBySkew doesn't consider this scene, medium has no SSD/HDD disk also skew,
cause rebalance exception
This commit is contained in:
dh-cloud
2021-12-28 15:03:29 +08:00
committed by GitHub
parent 07e2acb2f3
commit 3454735eba
1 changed files with 11 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
fe/fe-core/src/main/java/org/apache/doris/clone/TwoDimensionalGreedyRebalanceAlgo.java
View File

@ -135,6 +135,17 @@ public class TwoDimensionalGreedyRebalanceAlgo {
// Nothing to balance: cluster is empty.
return Lists.newArrayList();
}
NavigableSet<Long> keySet = info.beByTotalReplicaCount.keySet();
if (keySet.isEmpty() || keySet.last() == 0L) {
// the number of replica on specified medium we get from getReplicaNumByBeIdAndStorageMedium() is
// defined by table properties,but in fact there may not has SSD/HDD disk on this backend.
// So if we found that no SSD/HDD disk on this backend, set the replica number to 0,
// but the partitionInfoBySkew doesn't consider this scene, medium has no SSD/HDD disk also skew,
// cause rebalance exception
return Lists.newArrayList();
}
List<PartitionMove> moves = Lists.newArrayList();
for (int i = 0; i < maxMovesNum; ++i) {