database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

[Improvement](multi catalog)Move split size config to session variable (#18355)

Browse Source 
Move split size config to session variable. Before, it was in Config class, user need to restart FE after change it.
This commit is contained in:
Jibing-Li
2023-04-05 01:02:47 +08:00
committed by GitHub
parent 7f8d92656e
commit ea60d65384
7 changed files with 32 additions and 38 deletions
Download Patch File Download Diff File Expand all files Collapse all files

12
fe/fe-common/src/main/java/org/apache/doris/common/Config.java
View File

@ -1736,18 +1736,6 @@ public class Config extends ConfigBase {
@ConfField(mutable = false, masterOnly = true)
public static int backend_rpc_timeout_ms = 60000; // 1 min
@ConfField(mutable = true, masterOnly = false)
public static long file_scan_node_split_size = 256 * 1024 * 1024; // 256mb
@ConfField(mutable = true, masterOnly = false)
public static long file_scan_node_split_num = 128;
// 0 means use the block size in HDFS/S3 as split size.
// HDFS block size is 128MB, while S3 block size is 32MB.
// 32MB is too small for a S3 file split, so set 128MB as default split size.
@ConfField(mutable = true, masterOnly = false)
public static long file_split_size = 134217728;
/**
* If set to TRUE, FE will:
* 1. divide BE into high load and low load(no mid load) to force triggering tablet scheduling;