Commit Graph

70 Commits

Author SHA1 Message Date
9ff83eb378 dxf: systable and scheduler change for modify task at runtime (#57557)
ref pingcap/tidb#57497
2024-11-25 07:29:05 +00:00
e4e707d4a7 dxf: refactor failpoints in scheduler (#57566)
ref pingcap/tidb#57497
2024-11-21 03:46:45 +00:00
31c068c719 dxf: reduce indent of scheduleTask and some log refactor (#57501)
ref pingcap/tidb#57497
2024-11-20 08:44:02 +00:00
559f218988 dxf: fix the task num count incorrectly (#57127)
close pingcap/tidb#57172
2024-11-07 13:12:21 +00:00
44f100f80a disttask: fix flaky test TestParallelCancel (#55668)
close pingcap/tidb#55658
2024-08-26 12:46:45 +00:00
d041cd054c test: fix unstable TestParallelErrStage (#55620)
close pingcap/tidb#55594
2024-08-23 15:25:43 +00:00
d49a6541db test: switch some failpoints to InjectCall (#53588)
ref pingcap/tidb#49008
2024-05-28 04:50:49 +00:00
d1b8c5b4f1 ddl: refine fatal log when upgrade failed because of tidb_enable_dist_task (#53392) 2024-05-22 02:23:45 +00:00
d626b6adf0 disttask: fix scope can't set different value (#52627)
close pingcap/tidb#52441
2024-04-26 07:19:42 +00:00
f2ea18c07f lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
2024-04-01 07:13:46 +00:00
ad63eb8d1e disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
2024-03-29 04:20:19 +00:00
40456f36fe *: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
2024-03-25 11:59:17 +00:00
dfe6dbc94a disttask: make sure task meta consistent between scheduler and table (#51788)
close pingcap/tidb#51786
2024-03-14 12:20:10 +00:00
8b02143e2b disttask: skip scheduler take slots for some states (#51022)
ref pingcap/tidb#49008
2024-03-11 07:29:08 +00:00
6566269a35 disttask: refresh whole task info when state/step changed (#51426)
ref pingcap/tidb#49008
2024-03-05 11:11:06 +00:00
7b61b1a97b disttask: refine planErr state transition (#51279)
ref pingcap/tidb#49008
2024-02-27 07:26:08 +00:00
23190ff540 disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
2024-02-27 03:32:01 +00:00
a84d57c7da disttask: extract task/subtask base (#51231)
ref pingcap/tidb#49008
2024-02-23 03:55:57 +00:00
e34702f10e disttask: unify task order naming to 'rank' & refactor failpoint (#51136)
ref pingcap/tidb#49008
2024-02-21 03:37:57 +00:00
464a12651b build(deps): bump github.com/golangci/golangci-lint from 1.55.2 to 1.56.1 (#51089) 2024-02-18 06:57:01 +00:00
c5f2935e1b disttask: add integration test for resource control (#50962)
ref pingcap/tidb#49008
2024-02-05 09:05:44 +00:00
0fff995a9b disttask: fix routine leak & refine logs & refactor failpoint (#50912)
ref pingcap/tidb#49008
2024-02-04 06:56:42 +00:00
2c25e893be disttask: refactor metrics, collect metrics in scheduler manager (#50634)
close pingcap/tidb#49615
2024-01-31 11:01:54 +00:00
27fbccb1da disttask: workaround for #50089 to fix subtask rerun (#50821)
close pingcap/tidb#50818
2024-01-30 13:04:53 +00:00
be57d2fd87 disttask: mock to start multiple scheduler/taskexecutor (#50801)
ref pingcap/tidb#49008
2024-01-30 09:48:23 +00:00
51e1e13494 *: update interface{} to any (#50770)
ref pingcap/tidb#50765
2024-01-29 07:21:29 +00:00
40f0d1693b disttask: alloc or occupy resource when there are subtasks to run & fix scheduler block task (#50650)
ref pingcap/tidb#49008
2024-01-24 09:16:58 +00:00
87ffb95856 disttask: replace spool with waitgroup (#50664)
ref pingcap/tidb#49008
2024-01-24 04:00:21 +00:00
d1e6f1c291 disttask: remove revert subtask (#50550)
close pingcap/tidb#50549
2024-01-22 10:25:49 +00:00
8bb4d2f412 disttask: move step2Str to framework (#50565)
ref pingcap/tidb#49008
2024-01-22 03:12:19 +00:00
6c4b1ead78 disttask: refine logctx (#50503)
ref pingcap/tidb#48795
2024-01-18 12:25:47 +00:00
518f0afd87 disttask: fix data race when accessing task concurrently in scheduler (#50509)
close pingcap/tidb#50498
2024-01-17 10:30:16 +00:00
595fa7affc disttask: refine taskTable and remove useless code (#50461)
ref pingcap/tidb#48795
2024-01-17 04:06:15 +00:00
4d9c645933 test: fix flaky dispatch loop (#50446)
close pingcap/tidb#50409
2024-01-16 06:24:16 +00:00
720983a20c disttask: merge transfer task/subtask (#50311)
ref pingcap/tidb#48795, close pingcap/tidb#50310
2024-01-15 10:28:46 +00:00
56c619f1f5 disttask: remove useless task state (#50071)
ref pingcap/tidb#48795
2024-01-09 10:49:53 +00:00
386bb43fea disttask: consider node load when schedule/balance subtasks (#49758)
ref pingcap/tidb#49008
2024-01-09 09:06:24 +00:00
81f289d401 disttask: add tests for dist role (#50115)
ref pingcap/tidb#48795
2024-01-09 07:24:24 +00:00
f3d4ad5d89 disttask: fix can't reset service_scope (#50108)
close pingcap/tidb#50104
2024-01-08 11:42:30 +00:00
17d24f4cbf disttask: add more tests for task_state (#50090)
ref pingcap/tidb#48795
2024-01-05 05:47:24 +00:00
354c186066 disttask: record endtime for task and subtask (#49872)
close pingcap/tidb#49617
2024-01-04 03:03:33 +00:00
49dfd93cd5 disttask: init node meta inside domain (#49996)
close pingcap/tidb#49990
2024-01-03 10:29:02 +00:00
237b2c7d50 disttask: fix panic in task executor/scheduler (#49877)
close pingcap/tidb#49869
2024-01-02 12:18:32 +00:00
99f0349bfb disttask: fix failed step is taken as success (#49971)
close pingcap/tidb#49950
2024-01-02 10:57:32 +00:00
3d939d4b6f disttask: init capacity and check concurrency using cpu count of managed node (#49875)
ref pingcap/tidb#49008
2024-01-02 05:36:31 +00:00
8eed0437b3 disttask: split task and subtask state (#49896)
ref pingcap/tidb#48795
2023-12-29 10:04:58 +00:00
84d9bc3b6a importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
2023-12-29 07:27:35 +00:00
fbe232e3f8 disttask: check affacted row before start subtask (#49810)
ref pingcap/tidb#49008
2023-12-29 05:01:58 +00:00
3f4db1afa8 disttask: do not retry meta initialization if context done (#49881)
close pingcap/tidb#49753
2023-12-28 15:36:28 +00:00
60dbb615ab disttask: add notify when task submitted or changed & refactor test (#49805)
ref pingcap/tidb#49008
2023-12-28 06:42:28 +00:00