[Enhancement](compaction) enable the compaction producer to generate multiple compaction tasks in a single run (#45411) (#46160)

pick master #45411
2024-12-31 09:51:43 +08:00
parent 3d79955db3
commit df26475e1a
6 changed files with 276 additions and 13 deletions
--- a/be/src/common/config.cpp
+++ b/be/src/common/config.cpp
@ -1349,6 +1349,8 @@ DEFINE_mBool(enable_pipeline_task_leakage_detect, "false");
 DEFINE_Bool(force_regenerate_rowsetid_on_start_error, "false");
 DEFINE_mBool(enable_sleep_between_delete_cumu_compaction, "false");

+DEFINE_mInt32(compaction_num_per_round, "1");
+
 // clang-format off
 #ifdef BE_TEST
 // test s3