Commit Graph

58 Commits

Author SHA1 Message Date
9dc8189afa dxf: add metrics for alert purpose in nextgen (#64100)
ref pingcap/tidb#61702
2025-10-27 07:27:31 +00:00
9cd2b03833 dxf/crossks: check by inner fields not global var and make crossks real tikvtest work (#62918)
ref pingcap/tidb#61702
2025-08-14 15:00:03 +00:00
2a0741939c disttask: refine the speed calculation of import jobs (#62638)
ref pingcap/tidb#61088
2025-08-09 01:15:27 +00:00
3606de5c43 backend: add log fields for local and external pkg (#62476)
ref pingcap/tidb#61702
2025-07-18 05:49:42 +00:00
5ec4f36c85 dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
2025-07-09 08:07:27 +00:00
0a704a4bb7 *: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
2025-07-04 15:12:30 +00:00
254849d23a ddl, disttask: extend SubtaskSummary and add Collector interface (#61425)
ref pingcap/tidb#61088
2025-06-09 08:12:37 +00:00
c71ebaf73e global-sort: accelerate adding unique index using global sort (#60848)
ref pingcap/tidb#60621
2025-05-12 09:25:58 +00:00
1cd39430e1 *: inject random error for DXF (part2) (#60354)
ref pingcap/tidb#60277
2025-04-08 06:18:54 +00:00
811be5aaa5 disttask: add local disk space to node resource managed by DXF (#59607)
ref pingcap/tidb#49008
2025-02-20 08:42:09 +00:00
54384b7cbb ddl: modify param at runtime for add-index on DXF local sort (#59343)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
2025-02-19 13:43:09 +00:00
baf16005e0 ddl: part 1 of add-index integrating dxf dynamic modify param (#59046)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
2025-02-17 05:19:39 +00:00
fcdbbd49bb DXF: check the cause of subtaskCtx to decide the subtask state (#58893)
close pingcap/tidb#58827
2025-01-22 16:20:26 +00:00
b9b9787f17 dxf: support param modify for active running subtask (#58935)
ref pingcap/tidb#57497
2025-01-22 04:02:05 +00:00
c199ddfcdf disttask: cancel subtask context if scheduled away (#58615)
close pingcap/tidb#58450
2025-01-07 04:12:37 +00:00
293077b761 dxf: support modify concurrency/task-specific-param for later subtask at task executor part (#58144)
ref pingcap/tidb#57497
2024-12-27 13:05:21 +00:00
e62963d2c2 logutil/dxf: add a error verbose logger, and use it in DXF (#58185)
ref pingcap/tidb#57497
2024-12-12 11:41:06 +00:00
3adc71cc71 dxf: merge OnFinished into RunSubtask (#58098)
ref pingcap/tidb#57497
2024-12-10 09:26:21 +00:00
71e70af1b1 dxf: merge loops in Run and RunStep of task executor (#57944)
ref pingcap/tidb#57497
2024-12-09 07:32:51 +00:00
3002c1c1c7 dxf: refactor error handling in task executor (#57837)
ref pingcap/tidb#57497
2024-12-03 11:09:38 +00:00
d02d48acd9 dxf: refactor failpoints on task executor (#57680)
ref pingcap/tidb#57497
2024-11-26 03:49:00 +00:00
31c068c719 dxf: reduce indent of scheduleTask and some log refactor (#57501)
ref pingcap/tidb#57497
2024-11-20 08:44:02 +00:00
a00ba68b29 disttask: make task executor onError print error's stack. (#56618)
close pingcap/tidb#56014
2024-10-22 06:21:12 +00:00
d49a6541db test: switch some failpoints to InjectCall (#53588)
ref pingcap/tidb#49008
2024-05-28 04:50:49 +00:00
3004c07b93 copIterator: return context error to avoid return incorrect result on context cancel/timeout (#53489)
close pingcap/tidb#50089
2024-05-23 09:50:47 +00:00
f2ea18c07f lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
2024-04-01 07:13:46 +00:00
ad63eb8d1e disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
2024-03-29 04:20:19 +00:00
23190ff540 disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
2024-02-27 03:32:01 +00:00
a84d57c7da disttask: extract task/subtask base (#51231)
ref pingcap/tidb#49008
2024-02-23 03:55:57 +00:00
b634fbf518 disttask: rollback subtasks without init taskexecutor (#50987)
close pingcap/tidb#49008
2024-02-22 12:48:27 +00:00
6200123137 disttask: add benchmark to test scheduler overhead (#51182)
ref pingcap/tidb#49008
2024-02-21 10:50:03 +00:00
c5f2935e1b disttask: add integration test for resource control (#50962)
ref pingcap/tidb#49008
2024-02-05 09:05:44 +00:00
0fff995a9b disttask: fix routine leak & refine logs & refactor failpoint (#50912)
ref pingcap/tidb#49008
2024-02-04 06:56:42 +00:00
cac449b337 ddl, disttask: collect summary for each subtask (#50838)
ref pingcap/tidb#48795
2024-02-01 07:58:54 +00:00
2c25e893be disttask: refactor metrics, collect metrics in scheduler manager (#50634)
close pingcap/tidb#49615
2024-01-31 11:01:54 +00:00
27fbccb1da disttask: workaround for #50089 to fix subtask rerun (#50821)
close pingcap/tidb#50818
2024-01-30 13:04:53 +00:00
be57d2fd87 disttask: mock to start multiple scheduler/taskexecutor (#50801)
ref pingcap/tidb#49008
2024-01-30 09:48:23 +00:00
b5542c5ed2 disttask: decouple handleExecutableTask from manager & separate executor context (#50724)
ref pingcap/tidb#49008
2024-01-30 05:22:52 +00:00
40f0d1693b disttask: alloc or occupy resource when there are subtasks to run & fix scheduler block task (#50650)
ref pingcap/tidb#49008
2024-01-24 09:16:58 +00:00
87ffb95856 disttask: replace spool with waitgroup (#50664)
ref pingcap/tidb#49008
2024-01-24 04:00:21 +00:00
d1e6f1c291 disttask: remove revert subtask (#50550)
close pingcap/tidb#50549
2024-01-22 10:25:49 +00:00
8bb4d2f412 disttask: move step2Str to framework (#50565)
ref pingcap/tidb#49008
2024-01-22 03:12:19 +00:00
6c4b1ead78 disttask: refine logctx (#50503)
ref pingcap/tidb#48795
2024-01-18 12:25:47 +00:00
890230e17e disttask: add available resource param to step executor (#50475)
ref pingcap/tidb#49008
2024-01-17 11:51:16 +00:00
595fa7affc disttask: refine taskTable and remove useless code (#50461)
ref pingcap/tidb#48795
2024-01-17 04:06:15 +00:00
caa5539686 disttask: fix executor err handling missing part (#50429)
close pingcap/tidb#50417
2024-01-16 09:55:59 +00:00
17d65b9317 disttask: change extra running subtasks to pending (#50266)
ref pingcap/tidb#49008
2024-01-12 03:48:25 +00:00
91661e154c disttask: merge handle task loop (#50224)
ref pingcap/tidb#49008
2024-01-10 02:39:31 +00:00
237b2c7d50 disttask: fix panic in task executor/scheduler (#49877)
close pingcap/tidb#49869
2024-01-02 12:18:32 +00:00
99f0349bfb disttask: fix failed step is taken as success (#49971)
close pingcap/tidb#49950
2024-01-02 10:57:32 +00:00