|
|
720983a20c
|
disttask: merge transfer task/subtask (#50311)
ref pingcap/tidb#48795, close pingcap/tidb#50310
|
2024-01-15 10:28:46 +00:00 |
|
|
|
e87d94904a
|
lightning: always use PD HTTP client to access PD HTTP API (#50078)
ref pingcap/tidb#49865
|
2024-01-12 08:25:56 +00:00 |
|
|
|
17d65b9317
|
disttask: change extra running subtasks to pending (#50266)
ref pingcap/tidb#49008
|
2024-01-12 03:48:25 +00:00 |
|
|
|
e15c517afa
|
import/index: adjust concurrency using cpu-count of managed node depends on use case (#50091)
ref pingcap/tidb#49008
|
2024-01-10 08:31:54 +00:00 |
|
|
|
386bb43fea
|
disttask: consider node load when schedule/balance subtasks (#49758)
ref pingcap/tidb#49008
|
2024-01-09 09:06:24 +00:00 |
|
|
|
237b2c7d50
|
disttask: fix panic in task executor/scheduler (#49877)
close pingcap/tidb#49869
|
2024-01-02 12:18:32 +00:00 |
|
|
|
8eed0437b3
|
disttask: split task and subtask state (#49896)
ref pingcap/tidb#48795
|
2023-12-29 10:04:58 +00:00 |
|
|
|
84d9bc3b6a
|
importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
|
2023-12-29 07:27:35 +00:00 |
|
|
|
05a6702ef6
|
global sort: add 2-level iterator for merge property and range splitter (#49768)
close pingcap/tidb#49717
|
2023-12-28 08:48:28 +00:00 |
|
|
|
60dbb615ab
|
disttask: add notify when task submitted or changed & refactor test (#49805)
ref pingcap/tidb#49008
|
2023-12-28 06:42:28 +00:00 |
|
|
|
3e9bd47dfd
|
disttask: maintain managed nodes separately (#49623)
ref pingcap/tidb#49008
|
2023-12-22 08:51:24 +00:00 |
|
|
|
da460f11b0
|
global sort: fix broken prop with onefile writer (#49589)
close pingcap/tidb#49590
|
2023-12-20 08:54:23 +00:00 |
|
|
|
323b0f772b
|
*: remove deprecated LOAD DATA actions (#49470)
ref pingcap/tidb#44078
|
2023-12-15 14:00:21 +00:00 |
|
|
|
5519033a6c
|
disttask: insert subtasks in batch (#49282)
close pingcap/tidb#49281
|
2023-12-14 03:15:21 +00:00 |
|
|
|
64430c359e
|
disttask: rename dispatcher to scheduler (#49182)
close pingcap/tidb#49125
|
2023-12-13 03:33:22 +00:00 |
|
|
|
a7260ff598
|
disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
|
2023-12-11 13:49:48 +00:00 |
|
|
|
28cb579488
|
disttask: add IsRetryableError interface for taskExecutor (#49097)
ref pingcap/tidb#48795
|
2023-12-04 08:22:22 +00:00 |
|
|
|
b21bb3e7a7
|
disttask: rename scheduler to TaskExecutor (#49025)
ref pingcap/tidb#48795
|
2023-12-01 11:58:19 +00:00 |
|
|
|
3b419c5adc
|
disttask: add fields for resource control & remove global/g prefix from task (#49020)
close pingcap/tidb#49019
|
2023-12-01 04:35:48 +00:00 |
|
|
|
86df166bd3
|
importinto: make cancel wait task done and some fixes (#48928)
close pingcap/tidb#48736
|
2023-11-29 09:59:48 +00:00 |
|
|
|
3fe327aaff
|
importinto: add more ut (#48948)
ref pingcap/tidb#43820
|
2023-11-29 03:34:18 +00:00 |
|
|
|
8eb191303a
|
*: fix grpc client leak bug for AUTO_ID_CACHE=1 tables (#48870)
close pingcap/tidb#48869
|
2023-11-24 11:25:14 +00:00 |
|
|
|
9cf638fb08
|
global sort: merge to one file (#48142)
ref pingcap/tidb#45719
|
2023-11-23 08:46:12 +00:00 |
|
|
|
36cb29fd19
|
disttask: optimize metrics (#48663)
close pingcap/tidb#48592
|
2023-11-17 17:42:18 +00:00 |
|
|
|
844ba426b9
|
disttask: fix subtask finished immediately and mark success when encountering network partition (#48660)
ref pingcap/tidb#46258, close pingcap/tidb#48649
|
2023-11-17 13:00:48 +00:00 |
|
|
|
d4618d4a5f
|
disttask: fix wrong plan when filterByRole (#48366)
close pingcap/tidb#48368
|
2023-11-08 06:23:13 +00:00 |
|
|
|
4979e9985c
|
*: share etcd client from domain for autoid allocator (#46647)
close pingcap/tidb#46324
|
2023-11-06 05:54:40 +00:00 |
|
|
|
e392766f8e
|
importinto: calculate subtask count for global sort (#48169)
ref pingcap/tidb#47572
|
2023-11-03 02:59:17 +00:00 |
|
|
|
028d7b8c7b
|
external: merge overlapping files concurrently (#48073)
close pingcap/tidb#48072
|
2023-11-02 04:24:37 +00:00 |
|
|
|
99a4f35146
|
importinto: optimize write ingest step and fix oom (#48047)
ref pingcap/tidb#47572, close pingcap/tidb#47643
|
2023-10-31 11:48:38 +00:00 |
|
|
|
d1fc638f5b
|
*: record end key rather than max key (#47648)
close pingcap/tidb#47535
|
2023-10-27 08:20:05 +00:00 |
|
|
|
a7366f936d
|
importinto: fix data race in test (#47965)
close pingcap/tidb#47776
|
2023-10-26 02:23:03 +00:00 |
|
|
|
caaa35a05e
|
disttask/ddl: refine add index dispatcher for error handling (#47886)
ref pingcap/tidb#46258, close pingcap/tidb#47932
|
2023-10-23 14:36:33 +00:00 |
|
|
|
05b50a1ae1
|
external: pre-alloc mem for writer, use offset to avoid golang slice (#47793)
ref pingcap/tidb#47572
|
2023-10-23 08:15:32 +00:00 |
|
|
|
19784796fe
|
importinto: add more logs to external backend, disable parallel sort (#47680)
ref pingcap/tidb#47572
|
2023-10-17 06:40:58 +00:00 |
|
|
|
ab4c20ba16
|
importinto: revert "use one writer for each kv group for all concurrent encoder" (#47666)
ref pingcap/tidb#46704
|
2023-10-16 14:34:58 +00:00 |
|
|
|
46e53cdd31
|
disttask: cleanup framework meta when nodes shutdown (#47536)
ref pingcap/tidb#46258
|
2023-10-16 10:16:58 +00:00 |
|
|
|
b3dcf596b2
|
disttask: define TaskType/TaskState/Step instead of string/int64 (#47611)
ref pingcap/tidb#46258
|
2023-10-16 06:12:27 +00:00 |
|
|
|
318e82bbb7
|
*: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
|
2023-10-13 14:36:26 +00:00 |
|
