Commit Graph

25 Commits

Author SHA1 Message Date
64430c359e disttask: rename dispatcher to scheduler (#49182)
close pingcap/tidb#49125
2023-12-13 03:33:22 +00:00
a7260ff598 disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
2023-12-11 13:49:48 +00:00
28cb579488 disttask: add IsRetryableError interface for taskExecutor (#49097)
ref pingcap/tidb#48795
2023-12-04 08:22:22 +00:00
b21bb3e7a7 disttask: rename scheduler to TaskExecutor (#49025)
ref pingcap/tidb#48795
2023-12-01 11:58:19 +00:00
3b419c5adc disttask: add fields for resource control & remove global/g prefix from task (#49020)
close pingcap/tidb#49019
2023-12-01 04:35:48 +00:00
86df166bd3 importinto: make cancel wait task done and some fixes (#48928)
close pingcap/tidb#48736
2023-11-29 09:59:48 +00:00
3fe327aaff importinto: add more ut (#48948)
ref pingcap/tidb#43820
2023-11-29 03:34:18 +00:00
8eb191303a *: fix grpc client leak bug for AUTO_ID_CACHE=1 tables (#48870)
close pingcap/tidb#48869
2023-11-24 11:25:14 +00:00
9cf638fb08 global sort: merge to one file (#48142)
ref pingcap/tidb#45719
2023-11-23 08:46:12 +00:00
36cb29fd19 disttask: optimize metrics (#48663)
close pingcap/tidb#48592
2023-11-17 17:42:18 +00:00
844ba426b9 disttask: fix subtask finished immediately and mark success when encountering network partition (#48660)
ref pingcap/tidb#46258, close pingcap/tidb#48649
2023-11-17 13:00:48 +00:00
d4618d4a5f disttask: fix wrong plan when filterByRole (#48366)
close pingcap/tidb#48368
2023-11-08 06:23:13 +00:00
4979e9985c *: share etcd client from domain for autoid allocator (#46647)
close pingcap/tidb#46324
2023-11-06 05:54:40 +00:00
e392766f8e importinto: calculate subtask count for global sort (#48169)
ref pingcap/tidb#47572
2023-11-03 02:59:17 +00:00
028d7b8c7b external: merge overlapping files concurrently (#48073)
close pingcap/tidb#48072
2023-11-02 04:24:37 +00:00
99a4f35146 importinto: optimize write ingest step and fix oom (#48047)
ref pingcap/tidb#47572, close pingcap/tidb#47643
2023-10-31 11:48:38 +00:00
d1fc638f5b *: record end key rather than max key (#47648)
close pingcap/tidb#47535
2023-10-27 08:20:05 +00:00
a7366f936d importinto: fix data race in test (#47965)
close pingcap/tidb#47776
2023-10-26 02:23:03 +00:00
caaa35a05e disttask/ddl: refine add index dispatcher for error handling (#47886)
ref pingcap/tidb#46258, close pingcap/tidb#47932
2023-10-23 14:36:33 +00:00
05b50a1ae1 external: pre-alloc mem for writer, use offset to avoid golang slice (#47793)
ref pingcap/tidb#47572
2023-10-23 08:15:32 +00:00
19784796fe importinto: add more logs to external backend, disable parallel sort (#47680)
ref pingcap/tidb#47572
2023-10-17 06:40:58 +00:00
ab4c20ba16 importinto: revert "use one writer for each kv group for all concurrent encoder" (#47666)
ref pingcap/tidb#46704
2023-10-16 14:34:58 +00:00
46e53cdd31 disttask: cleanup framework meta when nodes shutdown (#47536)
ref pingcap/tidb#46258
2023-10-16 10:16:58 +00:00
b3dcf596b2 disttask: define TaskType/TaskState/Step instead of string/int64 (#47611)
ref pingcap/tidb#46258
2023-10-16 06:12:27 +00:00
318e82bbb7 *: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
2023-10-13 14:36:26 +00:00