Mingyu Chen e20cab64f4 [improvement](scan) avoid too many scanners for file scan node (#25727) ...

In previous, when using file scan node(eq, querying hive table), the max number of scanner for each scan node
will be the `doris_scanner_thread_pool_thread_num`(default is 48).
And if the query parallelism is N, the total number of scanner would be 48 * N, which is too many.

In this PR, I change the logic, the max number of scanner for each scan node
will be the `doris_scanner_thread_pool_thread_num / query parallelism`. So that the total number of scanners
will be up to `doris_scanner_thread_pool_thread_num`.

Reduce the number of scanner can significantly reduce the memory usage of query.

2023-10-29 17:41:31 +08:00

..

cmake

[refactor](mysql result format) use new serde framework to tuple convert (#25006)

2023-10-14 19:46:42 +08:00

src

[improvement](scan) avoid too many scanners for file scan node (#25727)

2023-10-29 17:41:31 +08:00

test

[refactor](move-memtable) rename open_stream_sink rpc to open_load_stream (#25883)

2023-10-29 10:07:14 +08:00

CMakeLists.txt

[Enhance](BE) Add -Wshadow-field compile option to avoid unexpected shadowing behavior (#25698)

2023-10-26 10:00:28 +08:00