Commit Graph

59 Commits

Author SHA1 Message Date
eb12403896 *: replace make then copy to slices.Clone (#62544)
close pingcap/tidb#62543
2025-07-31 12:27:55 +00:00
5ec4f36c85 dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
2025-07-09 08:07:27 +00:00
0a704a4bb7 *: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
2025-07-04 15:12:30 +00:00
dc876e5c51 disttask: gopls modernize (#60795)
close pingcap/tidb#60794
2025-04-28 10:06:26 +00:00
246a241621 dxf: add manual recovery mode (#59641)
ref pingcap/tidb#59640
2025-02-24 09:42:51 +00:00
811be5aaa5 disttask: add local disk space to node resource managed by DXF (#59607)
ref pingcap/tidb#49008
2025-02-20 08:42:09 +00:00
54384b7cbb ddl: modify param at runtime for add-index on DXF local sort (#59343)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
2025-02-19 13:43:09 +00:00
9099090462 dxf: add tidb_max_dist_task_nodes to specify max node count (#58937)
close pingcap/tidb#58944
2025-02-18 05:12:25 +00:00
62f9a39346 dxf: support modify app param on scheduler part (#58990)
ref pingcap/tidb#57497
2025-01-20 09:25:14 +00:00
293077b761 dxf: support modify concurrency/task-specific-param for later subtask at task executor part (#58144)
ref pingcap/tidb#57497
2024-12-27 13:05:21 +00:00
3adc71cc71 dxf: merge OnFinished into RunSubtask (#58098)
ref pingcap/tidb#57497
2024-12-10 09:26:21 +00:00
71e70af1b1 dxf: merge loops in Run and RunStep of task executor (#57944)
ref pingcap/tidb#57497
2024-12-09 07:32:51 +00:00
d02d48acd9 dxf: refactor failpoints on task executor (#57680)
ref pingcap/tidb#57497
2024-11-26 03:49:00 +00:00
9ff83eb378 dxf: systable and scheduler change for modify task at runtime (#57557)
ref pingcap/tidb#57497
2024-11-25 07:29:05 +00:00
04c66ee950 ddl: decouple job scheduler from 'ddl' and make it run/exit as owner changes (#53548)
ref pingcap/tidb#53246
2024-05-30 06:37:21 +00:00
d49a6541db test: switch some failpoints to InjectCall (#53588)
ref pingcap/tidb#49008
2024-05-28 04:50:49 +00:00
d626b6adf0 disttask: fix scope can't set different value (#52627)
close pingcap/tidb#52441
2024-04-26 07:19:42 +00:00
ad63eb8d1e disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
2024-03-29 04:20:19 +00:00
40456f36fe *: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
2024-03-25 11:59:17 +00:00
8b02143e2b disttask: skip scheduler take slots for some states (#51022)
ref pingcap/tidb#49008
2024-03-11 07:29:08 +00:00
6566269a35 disttask: refresh whole task info when state/step changed (#51426)
ref pingcap/tidb#49008
2024-03-05 11:11:06 +00:00
7b61b1a97b disttask: refine planErr state transition (#51279)
ref pingcap/tidb#49008
2024-02-27 07:26:08 +00:00
23190ff540 disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
2024-02-27 03:32:01 +00:00
6200123137 disttask: add benchmark to test scheduler overhead (#51182)
ref pingcap/tidb#49008
2024-02-21 10:50:03 +00:00
e34702f10e disttask: unify task order naming to 'rank' & refactor failpoint (#51136)
ref pingcap/tidb#49008
2024-02-21 03:37:57 +00:00
464a12651b build(deps): bump github.com/golangci/golangci-lint from 1.55.2 to 1.56.1 (#51089) 2024-02-18 06:57:01 +00:00
c5f2935e1b disttask: add integration test for resource control (#50962)
ref pingcap/tidb#49008
2024-02-05 09:05:44 +00:00
0fff995a9b disttask: fix routine leak & refine logs & refactor failpoint (#50912)
ref pingcap/tidb#49008
2024-02-04 06:56:42 +00:00
cac449b337 ddl, disttask: collect summary for each subtask (#50838)
ref pingcap/tidb#48795
2024-02-01 07:58:54 +00:00
be57d2fd87 disttask: mock to start multiple scheduler/taskexecutor (#50801)
ref pingcap/tidb#49008
2024-01-30 09:48:23 +00:00
b5542c5ed2 disttask: decouple handleExecutableTask from manager & separate executor context (#50724)
ref pingcap/tidb#49008
2024-01-30 05:22:52 +00:00
51e1e13494 *: update interface{} to any (#50770)
ref pingcap/tidb#50765
2024-01-29 07:21:29 +00:00
40f0d1693b disttask: alloc or occupy resource when there are subtasks to run & fix scheduler block task (#50650)
ref pingcap/tidb#49008
2024-01-24 09:16:58 +00:00
d1e6f1c291 disttask: remove revert subtask (#50550)
close pingcap/tidb#50549
2024-01-22 10:25:49 +00:00
890230e17e disttask: add available resource param to step executor (#50475)
ref pingcap/tidb#49008
2024-01-17 11:51:16 +00:00
595fa7affc disttask: refine taskTable and remove useless code (#50461)
ref pingcap/tidb#48795
2024-01-17 04:06:15 +00:00
720983a20c disttask: merge transfer task/subtask (#50311)
ref pingcap/tidb#48795, close pingcap/tidb#50310
2024-01-15 10:28:46 +00:00
17d65b9317 disttask: change extra running subtasks to pending (#50266)
ref pingcap/tidb#49008
2024-01-12 03:48:25 +00:00
986b00849c disttask: storage.util move to testutil (#50252)
ref pingcap/tidb#48795
2024-01-11 05:28:55 +00:00
386bb43fea disttask: consider node load when schedule/balance subtasks (#49758)
ref pingcap/tidb#49008
2024-01-09 09:06:24 +00:00
6eea739d4c testkit,store/mockstore: make store image to accelerate unit test (#42521)
close pingcap/tidb#42434
2024-01-05 09:05:41 +00:00
49dfd93cd5 disttask: init node meta inside domain (#49996)
close pingcap/tidb#49990
2024-01-03 10:29:02 +00:00
99f0349bfb disttask: fix failed step is taken as success (#49971)
close pingcap/tidb#49950
2024-01-02 10:57:32 +00:00
3d939d4b6f disttask: init capacity and check concurrency using cpu count of managed node (#49875)
ref pingcap/tidb#49008
2024-01-02 05:36:31 +00:00
84d9bc3b6a importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
2023-12-29 07:27:35 +00:00
60dbb615ab disttask: add notify when task submitted or changed & refactor test (#49805)
ref pingcap/tidb#49008
2023-12-28 06:42:28 +00:00
3e9bd47dfd disttask: maintain managed nodes separately (#49623)
ref pingcap/tidb#49008
2023-12-22 08:51:24 +00:00
b2d97523fa test: fix make ut for package disttask/framework (#49480)
close pingcap/tidb#49463
2023-12-15 02:52:49 +00:00
5519033a6c disttask: insert subtasks in batch (#49282)
close pingcap/tidb#49281
2023-12-14 03:15:21 +00:00
f7d2de06d5 disttask: fix hang in make ut (#49406)
close pingcap/tidb#49405
2023-12-13 08:42:33 +00:00