[feature](Load)(step2)support nereids load job schedule (#26356)
We will Integrate new load job manager into new job scheduling framework so that the insert into task can be scheduled after the broker load sql is converted to insert into TVF(table value function) sql. issue: https://github.com/apache/doris/issues/24221 Now support: 1. load data by tvf insert into sql, but just for simple load(columns need to be defined in the table) 2. show load stmt - job id, label name, job state, time info - simple progress 3. cancel load from db 4. support that enable new load through Config.enable_nereids_load 5. can replay job after restarting doris TODO: - support partition insert job - support show statistics from BE - support multiple task and collect task statistic - support transactional task - need add ut case
This commit is contained in:
@ -1931,6 +1931,18 @@ public class Config extends ConfigBase {
|
||||
@ConfField(masterOnly = true)
|
||||
public static boolean enable_hms_events_incremental_sync = false;
|
||||
|
||||
/**
|
||||
* If set to true, doris will try to parse the ddl of a hive view and try to execute the query
|
||||
* otherwise it will throw an AnalysisException.
|
||||
*/
|
||||
@ConfField(mutable = true, varType = VariableAnnotation.EXPERIMENTAL, description = {
|
||||
"当前默认设置为 false,开启后支持使用新优化器的load语句导入数据,失败后会降级旧的load语句。",
|
||||
"Now default set to true, After this function is enabled, the load statement of "
|
||||
+ "the new optimizer can be used to import data. If this function fails, "
|
||||
+ "the old load statement will be degraded."})
|
||||
public static boolean enable_nereids_load = false;
|
||||
|
||||
|
||||
/**
|
||||
* Maximum number of events to poll in each RPC.
|
||||
*/
|
||||
|
||||
Reference in New Issue
Block a user