Commit Graph

38 Commits

Author SHA1 Message Date
8e6d77ae27 dxf: add keyspace name to global task table (#61755)
ref pingcap/tidb#61702
2025-06-18 16:41:39 +00:00
dc876e5c51 disttask: gopls modernize (#60795)
close pingcap/tidb#60794
2025-04-28 10:06:26 +00:00
ed8b869a60 globalsort: write sorted kv meta to external storage (#59966)
close pingcap/tidb#60083
2025-03-26 09:39:54 +00:00
246a241621 dxf: add manual recovery mode (#59641)
ref pingcap/tidb#59640
2025-02-24 09:42:51 +00:00
811be5aaa5 disttask: add local disk space to node resource managed by DXF (#59607)
ref pingcap/tidb#49008
2025-02-20 08:42:09 +00:00
9099090462 dxf: add tidb_max_dist_task_nodes to specify max node count (#58937)
close pingcap/tidb#58944
2025-02-18 05:12:25 +00:00
62f9a39346 dxf: support modify app param on scheduler part (#58990)
ref pingcap/tidb#57497
2025-01-20 09:25:14 +00:00
87867ebf5f ddl/dxf: refine internal docs and some log refactor (#58881)
ref pingcap/tidb#57497
2025-01-14 06:14:08 +00:00
293077b761 dxf: support modify concurrency/task-specific-param for later subtask at task executor part (#58144)
ref pingcap/tidb#57497
2024-12-27 13:05:21 +00:00
71e70af1b1 dxf: merge loops in Run and RunStep of task executor (#57944)
ref pingcap/tidb#57497
2024-12-09 07:32:51 +00:00
e631ba8a9b dxf: handle modifying task concurrency in scheduler (#57673)
ref pingcap/tidb#57497
2024-12-02 14:05:17 +00:00
9ff83eb378 dxf: systable and scheduler change for modify task at runtime (#57557)
ref pingcap/tidb#57497
2024-11-25 07:29:05 +00:00
c43d0589be *: replace exportloopref with copyloopvar (#56503)
close pingcap/tidb#56509
2024-10-09 12:12:43 +00:00
d626b6adf0 disttask: fix scope can't set different value (#52627)
close pingcap/tidb#52441
2024-04-26 07:19:42 +00:00
23190ff540 disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
2024-02-27 03:32:01 +00:00
a84d57c7da disttask: extract task/subtask base (#51231)
ref pingcap/tidb#49008
2024-02-23 03:55:57 +00:00
e34702f10e disttask: unify task order naming to 'rank' & refactor failpoint (#51136)
ref pingcap/tidb#49008
2024-02-21 03:37:57 +00:00
2c25e893be disttask: refactor metrics, collect metrics in scheduler manager (#50634)
close pingcap/tidb#49615
2024-01-31 11:01:54 +00:00
d1e6f1c291 disttask: remove revert subtask (#50550)
close pingcap/tidb#50549
2024-01-22 10:25:49 +00:00
8bb4d2f412 disttask: move step2Str to framework (#50565)
ref pingcap/tidb#49008
2024-01-22 03:12:19 +00:00
6c4b1ead78 disttask: refine logctx (#50503)
ref pingcap/tidb#48795
2024-01-18 12:25:47 +00:00
890230e17e disttask: add available resource param to step executor (#50475)
ref pingcap/tidb#49008
2024-01-17 11:51:16 +00:00
17d65b9317 disttask: change extra running subtasks to pending (#50266)
ref pingcap/tidb#49008
2024-01-12 03:48:25 +00:00
56c619f1f5 disttask: remove useless task state (#50071)
ref pingcap/tidb#48795
2024-01-09 10:49:53 +00:00
237b2c7d50 disttask: fix panic in task executor/scheduler (#49877)
close pingcap/tidb#49869
2024-01-02 12:18:32 +00:00
3d939d4b6f disttask: init capacity and check concurrency using cpu count of managed node (#49875)
ref pingcap/tidb#49008
2024-01-02 05:36:31 +00:00
8eed0437b3 disttask: split task and subtask state (#49896)
ref pingcap/tidb#48795
2023-12-29 10:04:58 +00:00
a1d2b503c1 disttask: Refactor taskExecutor slotManager to handle task occupation (#49713)
ref pingcap/tidb#49008
2023-12-28 09:33:28 +00:00
5519033a6c disttask: insert subtasks in batch (#49282)
close pingcap/tidb#49281
2023-12-14 03:15:21 +00:00
3379450cec addindex/disttask: adjust add index task concurrency & add check when submit task (#49403)
ref pingcap/tidb#49008
2023-12-13 08:12:27 +00:00
64430c359e disttask: rename dispatcher to scheduler (#49182)
close pingcap/tidb#49125
2023-12-13 03:33:22 +00:00
a7260ff598 disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
2023-12-11 13:49:48 +00:00
b21bb3e7a7 disttask: rename scheduler to TaskExecutor (#49025)
ref pingcap/tidb#48795
2023-12-01 11:58:19 +00:00
3b419c5adc disttask: add fields for resource control & remove global/g prefix from task (#49020)
close pingcap/tidb#49019
2023-12-01 04:35:48 +00:00
ef02d72873 disttask: subtasks rebalance during task execution (#48306)
close pingcap/tidb#47298, ref pingcap/tidb#48795
2023-11-30 04:26:48 +00:00
86df166bd3 importinto: make cancel wait task done and some fixes (#48928)
close pingcap/tidb#48736
2023-11-29 09:59:48 +00:00
b3dcf596b2 disttask: define TaskType/TaskState/Step instead of string/int64 (#47611)
ref pingcap/tidb#46258
2023-10-16 06:12:27 +00:00
318e82bbb7 *: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
2023-10-13 14:36:26 +00:00