Commit Graph

39 Commits

Author SHA1 Message Date
b2d97523fa test: fix make ut for package disttask/framework (#49480)
close pingcap/tidb#49463
2023-12-15 02:52:49 +00:00
5519033a6c disttask: insert subtasks in batch (#49282)
close pingcap/tidb#49281
2023-12-14 03:15:21 +00:00
f7d2de06d5 disttask: fix hang in make ut (#49406)
close pingcap/tidb#49405
2023-12-13 08:42:33 +00:00
3379450cec addindex/disttask: adjust add index task concurrency & add check when submit task (#49403)
ref pingcap/tidb#49008
2023-12-13 08:12:27 +00:00
64430c359e disttask: rename dispatcher to scheduler (#49182)
close pingcap/tidb#49125
2023-12-13 03:33:22 +00:00
35ab481d96 disttask: refine table_test (#49382)
ref pingcap/tidb#48795
2023-12-12 13:09:26 +00:00
631ce093d2 disttask: fix service_scope replaced (#49246)
close pingcap/tidb#49245
2023-12-12 03:46:49 +00:00
a7260ff598 disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
2023-12-11 13:49:48 +00:00
28cb579488 disttask: add IsRetryableError interface for taskExecutor (#49097)
ref pingcap/tidb#48795
2023-12-04 08:22:22 +00:00
b21bb3e7a7 disttask: rename scheduler to TaskExecutor (#49025)
ref pingcap/tidb#48795
2023-12-01 11:58:19 +00:00
3b419c5adc disttask: add fields for resource control & remove global/g prefix from task (#49020)
close pingcap/tidb#49019
2023-12-01 04:35:48 +00:00
58505468e2 disttask: fix flaky multi task test (#49040)
close pingcap/tidb#49039
2023-11-30 08:53:57 +00:00
ef02d72873 disttask: subtasks rebalance during task execution (#48306)
close pingcap/tidb#47298, ref pingcap/tidb#48795
2023-11-30 04:26:48 +00:00
a1bb7aa682 disttask: test scheduler with real store and refine tests (#49000)
ref pingcap/tidb#48795
2023-11-29 14:16:17 +00:00
d4b41beec9 build/linter/util: exclude files according to the key of only_files (#48999)
close pingcap/tidb#48998
2023-11-29 11:17:47 +00:00
86df166bd3 importinto: make cancel wait task done and some fixes (#48928)
close pingcap/tidb#48736
2023-11-29 09:59:48 +00:00
845b20cbc9 disttask: mock dispatcher ext in UT (#48968)
ref pingcap/tidb#48795
2023-11-29 05:20:49 +00:00
01d441ef8a disttask: fix keep reporting error when cancel pending task (#48906)
close pingcap/tidb#48890
2023-11-27 06:16:15 +00:00
844ba426b9 disttask: fix subtask finished immediately and mark success when encountering network partition (#48660)
ref pingcap/tidb#46258, close pingcap/tidb#48649
2023-11-17 13:00:48 +00:00
311d8a2957 disttask: add awserr. RequestCanceled as graceful shutdown err (#48639)
close pingcap/tidb#48635
2023-11-16 10:11:17 +00:00
5a458cf136 disttask: fix cancel from grpc mark subtasks as failed (#48339)
close pingcap/tidb#48324
2023-11-08 08:50:20 +00:00
d4618d4a5f disttask: fix wrong plan when filterByRole (#48366)
close pingcap/tidb#48368
2023-11-08 06:23:13 +00:00
8071fc76d9 merge-sort: add context to errgroup, alloc mem by concurrency and refine logs (#48341)
close pingcap/tidb#48367
2023-11-08 03:54:42 +00:00
4e49859bf7 disttask: correct the usage of context (#48343)
close pingcap/tidb#48303
2023-11-07 11:53:11 +00:00
e392766f8e importinto: calculate subtask count for global sort (#48169)
ref pingcap/tidb#47572
2023-11-03 02:59:17 +00:00
99a4f35146 importinto: optimize write ingest step and fix oom (#48047)
ref pingcap/tidb#47572, close pingcap/tidb#47643
2023-10-31 11:48:38 +00:00
2b18f649e2 disttask/ddl: refine manager error handling (#48095)
ref pingcap/tidb#46258, close pingcap/tidb#48064
2023-10-31 09:27:38 +00:00
fab7825845 *: remove pkg/errors (#48081) 2023-10-31 03:15:37 +00:00
a2edc738de *: move sqlescaping from pkg/util/sqlexec to pkg/util/sqlescape (#48061)
close pingcap/tidb#48055
2023-10-31 01:45:36 +00:00
ca977c5111 disttask: add more retryable error (#48033)
ref pingcap/tidb#46258, close pingcap/tidb#48034
2023-10-27 09:44:04 +00:00
9224f62ef8 disttask: fix removing meta when met network partition for so long then recover from it (#48005)
close pingcap/tidb#47954
2023-10-27 03:11:05 +00:00
a7366f936d importinto: fix data race in test (#47965)
close pingcap/tidb#47776
2023-10-26 02:23:03 +00:00
caaa35a05e disttask/ddl: refine add index dispatcher for error handling (#47886)
ref pingcap/tidb#46258, close pingcap/tidb#47932
2023-10-23 14:36:33 +00:00
1cb25c74ed disttask: add sleep when subtask == nil (#47668)
ref pingcap/tidb#46258
2023-10-16 10:54:35 +00:00
46e53cdd31 disttask: cleanup framework meta when nodes shutdown (#47536)
ref pingcap/tidb#46258
2023-10-16 10:16:58 +00:00
eafb78a9c6 disttask: use merge sort meta (#47599)
ref pingcap/tidb#45719
2023-10-16 07:46:59 +00:00
b3dcf596b2 disttask: define TaskType/TaskState/Step instead of string/int64 (#47611)
ref pingcap/tidb#46258
2023-10-16 06:12:27 +00:00
9504d83392 disttask: more log (#47575)
ref pingcap/tidb#46258
2023-10-14 03:55:56 +00:00
318e82bbb7 *: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
2023-10-13 14:36:26 +00:00