[cherrypick](branch21) pick some exception handleing pr in page io (#40883)

## Proposed changes

pick
https://github.com/apache/doris/pull/39536
https://github.com/apache/doris/pull/39913
https://github.com/apache/doris/pull/39964
https://github.com/apache/doris/pull/40020

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
This commit is contained in:
yiguolei
2024-09-16 08:56:43 +08:00
committed by GitHub
parent 782973ee77
commit a6e2364f56
24 changed files with 97 additions and 89 deletions

View File

@ -152,14 +152,6 @@ public class LoadLoadingTask extends LoadTask {
curCoordinator.setExecMemoryLimit(execMemLimit);
curCoordinator.setExecPipEngine(Config.enable_pipeline_load);
/*
* For broker load job, user only need to set mem limit by 'exec_mem_limit' property.
* And the variable 'load_mem_limit' does not make any effect.
* However, in order to ensure the consistency of semantics when executing on the BE side,
* and to prevent subsequent modification from incorrectly setting the load_mem_limit,
* here we use exec_mem_limit to directly override the load_mem_limit property.
*/
curCoordinator.setLoadMemLimit(execMemLimit);
curCoordinator.setMemTableOnSinkNode(enableMemTableOnSinkNode);
long leftTimeMs = getLeftTimeMs();