[be](parameter) change default fragment_pool_thread_num_max from 512 to 2048 (#22448)

change some parameter's default value:
brpc_num_threads from -1 to 256
compaction_task_num_per_disk from 2 to 4
compaction_task_num_per_fast_disk from 4 to 8
fragment_pool_thread_num_max from 512 to 2048
fragment_pool_queue_size from 2048 to 4096

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
This commit is contained in:
yiguolei
2023-08-01 20:33:41 +08:00
committed by GitHub
parent 4d3e56e2e7
commit ff0fda460c
3 changed files with 13 additions and 13 deletions

View File

@ -62,7 +62,7 @@ DEFINE_Int32(brpc_port, "8060");
// the number of bthreads for brpc, the default value is set to -1,
// which means the number of bthreads is #cpu-cores
DEFINE_Int32(brpc_num_threads, "-1");
DEFINE_Int32(brpc_num_threads, "256");
// Declare a selection strategy for those servers have many ips.
// Note that there should at most one ip match this list.
@ -394,9 +394,9 @@ DEFINE_mInt32(update_replica_infos_interval_seconds, "60");
// Compaction task number per disk.
// Must be greater than 2, because Base compaction and Cumulative compaction have at least one thread each.
DEFINE_mInt32(compaction_task_num_per_disk, "2");
DEFINE_mInt32(compaction_task_num_per_disk, "4");
// compaction thread num for fast disk(typically .SSD), must be greater than 2.
DEFINE_mInt32(compaction_task_num_per_fast_disk, "4");
DEFINE_mInt32(compaction_task_num_per_fast_disk, "8");
DEFINE_Validator(compaction_task_num_per_disk,
[](const int config) -> bool { return config >= 2; });
DEFINE_Validator(compaction_task_num_per_fast_disk,
@ -492,8 +492,8 @@ DEFINE_mInt32(olap_table_sink_send_interval_ms, "1");
// Fragment thread pool
DEFINE_Int32(fragment_pool_thread_num_min, "64");
DEFINE_Int32(fragment_pool_thread_num_max, "512");
DEFINE_Int32(fragment_pool_queue_size, "2048");
DEFINE_Int32(fragment_pool_thread_num_max, "2048");
DEFINE_Int32(fragment_pool_queue_size, "4096");
// Control the number of disks on the machine. If 0, this comes from the system settings.
DEFINE_Int32(num_disks, "0");

View File

@ -326,7 +326,7 @@ There are two ways to configure BE configuration items:
#### `fragment_pool_queue_size`
* Description: The upper limit of query requests that can be processed on a single node
* Default value: 2048
* Default value: 4096
#### `fragment_pool_thread_num_min`
@ -336,7 +336,7 @@ There are two ways to configure BE configuration items:
#### `fragment_pool_thread_num_max`
* Description: Follow up query requests create threads dynamically, with a maximum of 512 threads created.
* Default value: 512
* Default value: 2048
#### `doris_max_pushdown_conjuncts_return_rate`
@ -596,13 +596,13 @@ BaseCompaction:546859:
* Type: int32
* Description: The number of compaction tasks which execute in parallel for a disk(HDD).
* Default value: 2
* Default value: 4
#### `compaction_task_num_per_fast_disk`
* Type: int32
* Description: The number of compaction tasks which execute in parallel for a fast disk(SSD).
* Default value: 4
* Default value: 8
#### `cumulative_compaction_rounds_for_each_base_compaction_round`

View File

@ -337,7 +337,7 @@ BE 重启后该配置将失效。如果想持久化修改结果,使用如下
#### `fragment_pool_queue_size`
* 描述:单节点上能够处理的查询请求上限
* 默认值:2048
* 默认值:4096
#### `fragment_pool_thread_num_min`
@ -347,7 +347,7 @@ BE 重启后该配置将失效。如果想持久化修改结果,使用如下
#### `fragment_pool_thread_num_max`
* 描述:后续查询请求动态创建线程,最大创建512个线程。
* 默认值:512
* 默认值:2048
#### `doris_max_pushdown_conjuncts_return_rate`
@ -610,13 +610,13 @@ BaseCompaction:546859:
* 类型:int32
* 描述:每个磁盘(HDD)可以并发执行的compaction任务数量。
* 默认值:2
* 默认值:4
#### `compaction_task_num_per_fast_disk`
* 类型:int32
* 描述:每个高速磁盘(SSD)可以并发执行的compaction任务数量。
* 默认值:4
* 默认值:8
#### `cumulative_compaction_rounds_for_each_base_compaction_round`