Commit Graph

66 Commits

Author SHA1 Message Date
62d4039184 disttask: fix submit task with same key (#50317)
close pingcap/tidb#50318
2024-01-11 09:27:32 +00:00
e3abcbbe68 test: fix race in TestManagerHandleTasks (#50304)
close pingcap/tidb#50297
2024-01-11 05:57:25 +00:00
986b00849c disttask: storage.util move to testutil (#50252)
ref pingcap/tidb#48795
2024-01-11 05:28:55 +00:00
e15c517afa import/index: adjust concurrency using cpu-count of managed node depends on use case (#50091)
ref pingcap/tidb#49008
2024-01-10 08:31:54 +00:00
91661e154c disttask: merge handle task loop (#50224)
ref pingcap/tidb#49008
2024-01-10 02:39:31 +00:00
56c619f1f5 disttask: remove useless task state (#50071)
ref pingcap/tidb#48795
2024-01-09 10:49:53 +00:00
386bb43fea disttask: consider node load when schedule/balance subtasks (#49758)
ref pingcap/tidb#49008
2024-01-09 09:06:24 +00:00
81f289d401 disttask: add tests for dist role (#50115)
ref pingcap/tidb#48795
2024-01-09 07:24:24 +00:00
f3d4ad5d89 disttask: fix can't reset service_scope (#50108)
close pingcap/tidb#50104
2024-01-08 11:42:30 +00:00
6eea739d4c testkit,store/mockstore: make store image to accelerate unit test (#42521)
close pingcap/tidb#42434
2024-01-05 09:05:41 +00:00
17d24f4cbf disttask: add more tests for task_state (#50090)
ref pingcap/tidb#48795
2024-01-05 05:47:24 +00:00
cdc7572a26 disttask: fix potential panic in task executor (#50058)
ref pingcap/tidb#48795
2024-01-04 04:47:10 +00:00
354c186066 disttask: record endtime for task and subtask (#49872)
close pingcap/tidb#49617
2024-01-04 03:03:33 +00:00
49dfd93cd5 disttask: init node meta inside domain (#49996)
close pingcap/tidb#49990
2024-01-03 10:29:02 +00:00
a28d46bf14 test: fix flaky case (#50008)
close pingcap/tidb#49984
2024-01-03 07:03:39 +00:00
237b2c7d50 disttask: fix panic in task executor/scheduler (#49877)
close pingcap/tidb#49869
2024-01-02 12:18:32 +00:00
99f0349bfb disttask: fix failed step is taken as success (#49971)
close pingcap/tidb#49950
2024-01-02 10:57:32 +00:00
3d939d4b6f disttask: init capacity and check concurrency using cpu count of managed node (#49875)
ref pingcap/tidb#49008
2024-01-02 05:36:31 +00:00
8eed0437b3 disttask: split task and subtask state (#49896)
ref pingcap/tidb#48795
2023-12-29 10:04:58 +00:00
84d9bc3b6a importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
2023-12-29 07:27:35 +00:00
fbe232e3f8 disttask: check affacted row before start subtask (#49810)
ref pingcap/tidb#49008
2023-12-29 05:01:58 +00:00
3f4db1afa8 disttask: do not retry meta initialization if context done (#49881)
close pingcap/tidb#49753
2023-12-28 15:36:28 +00:00
a1d2b503c1 disttask: Refactor taskExecutor slotManager to handle task occupation (#49713)
ref pingcap/tidb#49008
2023-12-28 09:33:28 +00:00
60dbb615ab disttask: add notify when task submitted or changed & refactor test (#49805)
ref pingcap/tidb#49008
2023-12-28 06:42:28 +00:00
a7ef915052 *: upgrade rules_go (#49693) 2023-12-27 02:15:28 +00:00
3e9bd47dfd disttask: maintain managed nodes separately (#49623)
ref pingcap/tidb#49008
2023-12-22 08:51:24 +00:00
27aed3196f disttask: task executor slot manager (#49136)
close pingcap/tidb#49135
2023-12-20 06:48:23 +00:00
b2d97523fa test: fix make ut for package disttask/framework (#49480)
close pingcap/tidb#49463
2023-12-15 02:52:49 +00:00
5519033a6c disttask: insert subtasks in batch (#49282)
close pingcap/tidb#49281
2023-12-14 03:15:21 +00:00
f7d2de06d5 disttask: fix hang in make ut (#49406)
close pingcap/tidb#49405
2023-12-13 08:42:33 +00:00
3379450cec addindex/disttask: adjust add index task concurrency & add check when submit task (#49403)
ref pingcap/tidb#49008
2023-12-13 08:12:27 +00:00
64430c359e disttask: rename dispatcher to scheduler (#49182)
close pingcap/tidb#49125
2023-12-13 03:33:22 +00:00
35ab481d96 disttask: refine table_test (#49382)
ref pingcap/tidb#48795
2023-12-12 13:09:26 +00:00
631ce093d2 disttask: fix service_scope replaced (#49246)
close pingcap/tidb#49245
2023-12-12 03:46:49 +00:00
a7260ff598 disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
2023-12-11 13:49:48 +00:00
28cb579488 disttask: add IsRetryableError interface for taskExecutor (#49097)
ref pingcap/tidb#48795
2023-12-04 08:22:22 +00:00
b21bb3e7a7 disttask: rename scheduler to TaskExecutor (#49025)
ref pingcap/tidb#48795
2023-12-01 11:58:19 +00:00
3b419c5adc disttask: add fields for resource control & remove global/g prefix from task (#49020)
close pingcap/tidb#49019
2023-12-01 04:35:48 +00:00
58505468e2 disttask: fix flaky multi task test (#49040)
close pingcap/tidb#49039
2023-11-30 08:53:57 +00:00
ef02d72873 disttask: subtasks rebalance during task execution (#48306)
close pingcap/tidb#47298, ref pingcap/tidb#48795
2023-11-30 04:26:48 +00:00
a1bb7aa682 disttask: test scheduler with real store and refine tests (#49000)
ref pingcap/tidb#48795
2023-11-29 14:16:17 +00:00
d4b41beec9 build/linter/util: exclude files according to the key of only_files (#48999)
close pingcap/tidb#48998
2023-11-29 11:17:47 +00:00
86df166bd3 importinto: make cancel wait task done and some fixes (#48928)
close pingcap/tidb#48736
2023-11-29 09:59:48 +00:00
845b20cbc9 disttask: mock dispatcher ext in UT (#48968)
ref pingcap/tidb#48795
2023-11-29 05:20:49 +00:00
01d441ef8a disttask: fix keep reporting error when cancel pending task (#48906)
close pingcap/tidb#48890
2023-11-27 06:16:15 +00:00
844ba426b9 disttask: fix subtask finished immediately and mark success when encountering network partition (#48660)
ref pingcap/tidb#46258, close pingcap/tidb#48649
2023-11-17 13:00:48 +00:00
311d8a2957 disttask: add awserr. RequestCanceled as graceful shutdown err (#48639)
close pingcap/tidb#48635
2023-11-16 10:11:17 +00:00
5a458cf136 disttask: fix cancel from grpc mark subtasks as failed (#48339)
close pingcap/tidb#48324
2023-11-08 08:50:20 +00:00
d4618d4a5f disttask: fix wrong plan when filterByRole (#48366)
close pingcap/tidb#48368
2023-11-08 06:23:13 +00:00
8071fc76d9 merge-sort: add context to errgroup, alloc mem by concurrency and refine logs (#48341)
close pingcap/tidb#48367
2023-11-08 03:54:42 +00:00