database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

[pipeline](doc) Update pipeline doc (#20623)

Browse Source
This commit is contained in:
Gabriel
2023-06-09 12:38:36 +08:00
committed by GitHub
parent 44e20d9087
commit 101e75d633
2 changed files with 6 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
docs/en/docs/query-acceleration/pipeline-execution-engine.md
View File

@ -69,15 +69,10 @@ This improves the efficiency of CPU execution on mixed-load SQL and enhances the
set enable_pipeline_engine = true;
```
#### parallel_fragment_exec_instance_num
#### parallel_pipeline_task_num
The default configuration of `parallel_fragment_exec_instance_num` represents the number of instances that a SQL query will query concurrently; Doris defaults to `1`, which affects the number of query threads in the non-Pipeline execution engine, whereas in the Pipeline execution engine there is no thread inflation This configuration affects the number of threads in the Non-Pipeline execution engine. The recommended configuration here is `16`, but users can actually adjust it to suit their own queries.
`parallel_pipeline_task_num` represents the concurrency of pipeline tasks of a query. Default value is `0` (e.g. half number of CPU cores). Users can adjust this value according to their own workloads.
```
set parallel_fragment_exec_instance_num = 16;
set parallel_pipeline_task_num = 0;
```
Specifically, if set to 0, the concurrency in the Pipeline execution engine will automatically be set to half of the number of CPU cores.
"parallel_fragment_exec_instance_num" cannot be set higher than the "max_instance_num" in "fe.conf" (default is 128).

7
docs/zh-CN/docs/query-acceleration/pipeline-execution-engine.md
View File

@ -69,12 +69,11 @@ Pipeline 执行引擎 是 Doris 在 2.0 版本加入的实验性功能。目标
set enable_pipeline_engine = true;
```
#### parallel_fragment_exec_instance_num
#### parallel_pipeline_task_num
`parallel_fragment_exec_instance_num`代表了 SQL 查询进行查询并发的 Instance 数目。Doris默认的配置为`1`,这个配置会影响非 Pipeline 执行引擎的查询线程数目，而在 Pipeline 执行引擎中不会有线程数目膨胀的问题。这里推荐配置为`16`，用户也可以实际根据自己的查询情况进行调整。
`parallel_pipeline_task_num`代表了 SQL 查询进行查询并发的 Pipeline Task 数目。Doris默认的配置为`0`,即CPU核数的一半。用户也可以实际根据自己的实际情况进行调整。
```
set parallel_fragment_exec_instance_num = 16;
set parallel_pipeline_task_num = 0;
```
特别的，如果设置为0， 则在Pipeline 执行引擎中的并发数会自动的设置为cpu核心数目的一半。并且parallel_fragment_exec_instance_num不能设置超过fe.conf中的max_instance_num(默认128)