|
|
61c471487e
|
globalsort: split files evenly in MergeOverlappingFiles (#51878)
ref pingcap/tidb#50752
|
2024-03-19 08:41:13 +00:00 |
|
|
|
5a2b8e8e1a
|
importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
|
2024-03-18 07:54:42 +00:00 |
|
|
|
222fe17e25
|
global sort: remove some unused code (#51811)
ref pingcap/tidb#50752
|
2024-03-15 12:48:40 +00:00 |
|
|
|
dbdae85432
|
importinto, disttask: allow multi import job & adjust total memory for cgroup v2 (#51575)
ref pingcap/tidb#49008
|
2024-03-14 05:05:09 +00:00 |
|
|
|
b55c855142
|
importinto: fix incorrect index kv group count when table have common handle (#51615)
ref pingcap/tidb#50752
|
2024-03-08 07:06:36 +00:00 |
|
|
|
911bcf16a8
|
importinto: calculate writer mem size using step resource & add a option for test (#51486)
ref pingcap/tidb#49008
|
2024-03-07 10:59:06 +00:00 |
|
|
|
6566269a35
|
disttask: refresh whole task info when state/step changed (#51426)
ref pingcap/tidb#49008
|
2024-03-05 11:11:06 +00:00 |
|
|
|
4182a418c8
|
*: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
|
2024-02-29 07:42:31 +00:00 |
|
|
|
332086ebc8
|
importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
|
2024-02-27 09:05:09 +00:00 |
|
|
|
23190ff540
|
disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
|
2024-02-27 03:32:01 +00:00 |
|
|
|
a84d57c7da
|
disttask: extract task/subtask base (#51231)
ref pingcap/tidb#49008
|
2024-02-23 03:55:57 +00:00 |
|
|
|
e34702f10e
|
disttask: unify task order naming to 'rank' & refactor failpoint (#51136)
ref pingcap/tidb#49008
|
2024-02-21 03:37:57 +00:00 |
|
|
|
65d57c0a43
|
import into: log checksum for each KV group (#50871)
ref pingcap/tidb#50832
|
2024-02-18 08:55:55 +00:00 |
|
|
|
ba778070a2
|
external: onefile writer should have onClose, and add KV count to WriteSummary (#50955)
ref pingcap/tidb#50832
|
2024-02-04 09:32:43 +00:00 |
|
|
|
cac449b337
|
ddl, disttask: collect summary for each subtask (#50838)
ref pingcap/tidb#48795
|
2024-02-01 07:58:54 +00:00 |
|
|
|
b5542c5ed2
|
disttask: decouple handleExecutableTask from manager & separate executor context (#50724)
ref pingcap/tidb#49008
|
2024-01-30 05:22:52 +00:00 |
|
|
|
51e1e13494
|
*: update interface{} to any (#50770)
ref pingcap/tidb#50765
|
2024-01-29 07:21:29 +00:00 |
|
|
|
87ffb95856
|
disttask: replace spool with waitgroup (#50664)
ref pingcap/tidb#49008
|
2024-01-24 04:00:21 +00:00 |
|
|
|
7ce7fb2a85
|
external: round robin to use multiple GCS clients (#50408)
close pingcap/tidb#50413
|
2024-01-23 09:43:49 +00:00 |
|
|
|
d1e6f1c291
|
disttask: remove revert subtask (#50550)
close pingcap/tidb#50549
|
2024-01-22 10:25:49 +00:00 |
|
|
|
8bb4d2f412
|
disttask: move step2Str to framework (#50565)
ref pingcap/tidb#49008
|
2024-01-22 03:12:19 +00:00 |
|
|
|
890230e17e
|
disttask: add available resource param to step executor (#50475)
ref pingcap/tidb#49008
|
2024-01-17 11:51:16 +00:00 |
|
|
|
5fee75661a
|
lightning: use SprintfWithIdentifier to process strings with identifier (#50434)
ref pingcap/tidb#30699
|
2024-01-17 08:34:47 +00:00 |
|
|
|
720983a20c
|
disttask: merge transfer task/subtask (#50311)
ref pingcap/tidb#48795, close pingcap/tidb#50310
|
2024-01-15 10:28:46 +00:00 |
|
|
|
e87d94904a
|
lightning: always use PD HTTP client to access PD HTTP API (#50078)
ref pingcap/tidb#49865
|
2024-01-12 08:25:56 +00:00 |
|
|
|
17d65b9317
|
disttask: change extra running subtasks to pending (#50266)
ref pingcap/tidb#49008
|
2024-01-12 03:48:25 +00:00 |
|
|
|
e15c517afa
|
import/index: adjust concurrency using cpu-count of managed node depends on use case (#50091)
ref pingcap/tidb#49008
|
2024-01-10 08:31:54 +00:00 |
|
|
|
386bb43fea
|
disttask: consider node load when schedule/balance subtasks (#49758)
ref pingcap/tidb#49008
|
2024-01-09 09:06:24 +00:00 |
|
|
|
237b2c7d50
|
disttask: fix panic in task executor/scheduler (#49877)
close pingcap/tidb#49869
|
2024-01-02 12:18:32 +00:00 |
|
|
|
8eed0437b3
|
disttask: split task and subtask state (#49896)
ref pingcap/tidb#48795
|
2023-12-29 10:04:58 +00:00 |
|
|
|
84d9bc3b6a
|
importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
|
2023-12-29 07:27:35 +00:00 |
|
|
|
05a6702ef6
|
global sort: add 2-level iterator for merge property and range splitter (#49768)
close pingcap/tidb#49717
|
2023-12-28 08:48:28 +00:00 |
|
|
|
60dbb615ab
|
disttask: add notify when task submitted or changed & refactor test (#49805)
ref pingcap/tidb#49008
|
2023-12-28 06:42:28 +00:00 |
|
|
|
3e9bd47dfd
|
disttask: maintain managed nodes separately (#49623)
ref pingcap/tidb#49008
|
2023-12-22 08:51:24 +00:00 |
|
|
|
da460f11b0
|
global sort: fix broken prop with onefile writer (#49589)
close pingcap/tidb#49590
|
2023-12-20 08:54:23 +00:00 |
|
|
|
323b0f772b
|
*: remove deprecated LOAD DATA actions (#49470)
ref pingcap/tidb#44078
|
2023-12-15 14:00:21 +00:00 |
|
|
|
5519033a6c
|
disttask: insert subtasks in batch (#49282)
close pingcap/tidb#49281
|
2023-12-14 03:15:21 +00:00 |
|
|
|
64430c359e
|
disttask: rename dispatcher to scheduler (#49182)
close pingcap/tidb#49125
|
2023-12-13 03:33:22 +00:00 |
|
|
|
a7260ff598
|
disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
|
2023-12-11 13:49:48 +00:00 |
|
|
|
28cb579488
|
disttask: add IsRetryableError interface for taskExecutor (#49097)
ref pingcap/tidb#48795
|
2023-12-04 08:22:22 +00:00 |
|
|
|
b21bb3e7a7
|
disttask: rename scheduler to TaskExecutor (#49025)
ref pingcap/tidb#48795
|
2023-12-01 11:58:19 +00:00 |
|
|
|
3b419c5adc
|
disttask: add fields for resource control & remove global/g prefix from task (#49020)
close pingcap/tidb#49019
|
2023-12-01 04:35:48 +00:00 |
|
|
|
86df166bd3
|
importinto: make cancel wait task done and some fixes (#48928)
close pingcap/tidb#48736
|
2023-11-29 09:59:48 +00:00 |
|
|
|
3fe327aaff
|
importinto: add more ut (#48948)
ref pingcap/tidb#43820
|
2023-11-29 03:34:18 +00:00 |
|
|
|
8eb191303a
|
*: fix grpc client leak bug for AUTO_ID_CACHE=1 tables (#48870)
close pingcap/tidb#48869
|
2023-11-24 11:25:14 +00:00 |
|
|
|
9cf638fb08
|
global sort: merge to one file (#48142)
ref pingcap/tidb#45719
|
2023-11-23 08:46:12 +00:00 |
|
|
|
36cb29fd19
|
disttask: optimize metrics (#48663)
close pingcap/tidb#48592
|
2023-11-17 17:42:18 +00:00 |
|
|
|
844ba426b9
|
disttask: fix subtask finished immediately and mark success when encountering network partition (#48660)
ref pingcap/tidb#46258, close pingcap/tidb#48649
|
2023-11-17 13:00:48 +00:00 |
|
|
|
d4618d4a5f
|
disttask: fix wrong plan when filterByRole (#48366)
close pingcap/tidb#48368
|
2023-11-08 06:23:13 +00:00 |
|
|
|
4979e9985c
|
*: share etcd client from domain for autoid allocator (#46647)
close pingcap/tidb#46324
|
2023-11-06 05:54:40 +00:00 |
|
