|
|
246a241621
|
dxf: add manual recovery mode (#59641)
ref pingcap/tidb#59640
|
2025-02-24 09:42:51 +00:00 |
|
|
|
e2d5d1c017
|
import-into: support running with 1 thread when using global sort (#58572)
close pingcap/tidb#58680
|
2025-02-24 06:30:23 +00:00 |
|
|
|
811be5aaa5
|
disttask: add local disk space to node resource managed by DXF (#59607)
ref pingcap/tidb#49008
|
2025-02-20 08:42:09 +00:00 |
|
|
|
9099090462
|
dxf: add tidb_max_dist_task_nodes to specify max node count (#58937)
close pingcap/tidb#58944
|
2025-02-18 05:12:25 +00:00 |
|
|
|
fc0adfcf28
|
lightning/global-sort: move membuf pkg from br to lightning (#59550)
ref pingcap/tidb#57275
|
2025-02-14 09:19:19 +00:00 |
|
|
|
435a716670
|
import: fix oom on global sort when the target table has large number of indices (#59518)
close pingcap/tidb#59508
|
2025-02-14 06:13:19 +00:00 |
|
|
|
62f9a39346
|
dxf: support modify app param on scheduler part (#58990)
ref pingcap/tidb#57497
|
2025-01-20 09:25:14 +00:00 |
|
|
|
f7c94c80c5
|
ddl/dxf: some rename and merge explicit impl of scheduler.Extension with scheduler (#59013)
ref pingcap/tidb#57497
|
2025-01-17 09:55:29 +00:00 |
|
|
|
b2f2faaa95
|
parser: move 'model' to 'ast' pkg (#58704)
ref pingcap/tidb#54436
|
2025-01-07 10:20:04 +00:00 |
|
|
|
bf939fa79a
|
*: don't handle live updates of column size (#58596)
close pingcap/tidb#58595
|
2025-01-06 19:42:49 +00:00 |
|
|
|
293077b761
|
dxf: support modify concurrency/task-specific-param for later subtask at task executor part (#58144)
ref pingcap/tidb#57497
|
2024-12-27 13:05:21 +00:00 |
|
|
|
14a469ab9d
|
*: upgrade the PD client to adopt the latest refactor (#58440)
ref pingcap/tidb#58439
|
2024-12-23 10:36:12 +00:00 |
|
|
|
588b273f67
|
global sort: add boundaries to split keys when generating plan (#58323)
close pingcap/tidb#58267
|
2024-12-17 15:04:30 +00:00 |
|
|
|
3adc71cc71
|
dxf: merge OnFinished into RunSubtask (#58098)
ref pingcap/tidb#57497
|
2024-12-10 09:26:21 +00:00 |
|
|
|
e631ba8a9b
|
dxf: handle modifying task concurrency in scheduler (#57673)
ref pingcap/tidb#57497
|
2024-12-02 14:05:17 +00:00 |
|
|
|
ecca340037
|
lightning: fix id too large after parallel import (#57398)
close pingcap/tidb#56814
|
2024-11-19 11:03:32 +00:00 |
|
|
|
3578e29613
|
lightning: job range keys and region split keys are 2 concepts (part 2) (#55759)
close pingcap/tidb#55374
|
2024-09-05 01:31:35 +00:00 |
|
|
|
3176b9c263
|
*: move XXInfo/Job, etc, out from model pkg in parser to meta (#55754)
ref pingcap/tidb#54436
|
2024-09-04 04:49:45 +00:00 |
|
|
|
c65692b9b2
|
external: range job keys and region split keys are 2 concepts (part 1) (#55659)
ref pingcap/tidb#55374
|
2024-08-30 10:50:48 +00:00 |
|
|
|
ae9e196dae
|
workerpool: add TaskMayPanic interface to remind caller handles panic (#55537)
ref pingcap/tidb#55497
|
2024-08-21 07:27:12 +00:00 |
|
|
|
f490a98438
|
*: add context.Context parameter to infoschema TableByName (#54479)
ref pingcap/tidb#50959
|
2024-07-09 16:04:33 +00:00 |
|
|
|
d49a6541db
|
test: switch some failpoints to InjectCall (#53588)
ref pingcap/tidb#49008
|
2024-05-28 04:50:49 +00:00 |
|
|
|
f46db203f9
|
*: caller can use a fixed TS for fast reorg (#52993)
close pingcap/tidb#46986, ref pingcap/tidb#49233
|
2024-05-10 13:31:09 +00:00 |
|
|
|
d626b6adf0
|
disttask: fix scope can't set different value (#52627)
close pingcap/tidb#52441
|
2024-04-26 07:19:42 +00:00 |
|
|
|
72e5460ee8
|
lightning/importinto: fix insert err after import for AUTO_ID_CACHE=1 and SHARD_ROW_ID_BITS (#52712)
close pingcap/tidb#52654
|
2024-04-18 08:10:38 +00:00 |
|
|
|
76abd8b836
|
disttask,ddl: use subtask concurrency (#52286)
ref pingcap/tidb#49008
|
2024-04-02 04:24:16 +00:00 |
|
|
|
f2ea18c07f
|
lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
|
2024-04-01 07:13:46 +00:00 |
|
|
|
ad63eb8d1e
|
disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
|
2024-03-29 04:20:19 +00:00 |
|
|
|
40456f36fe
|
*: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
|
2024-03-25 11:59:17 +00:00 |
|
|
|
490e17c9ab
|
importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
|
2024-03-25 05:45:46 +00:00 |
|
|
|
df79e5ca11
|
globalsort: opt merge step mem to run on 8c (#51924)
ref pingcap/tidb#50752
|
2024-03-22 10:36:50 +00:00 |
|
|
|
61c471487e
|
globalsort: split files evenly in MergeOverlappingFiles (#51878)
ref pingcap/tidb#50752
|
2024-03-19 08:41:13 +00:00 |
|
|
|
5a2b8e8e1a
|
importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
|
2024-03-18 07:54:42 +00:00 |
|
|
|
222fe17e25
|
global sort: remove some unused code (#51811)
ref pingcap/tidb#50752
|
2024-03-15 12:48:40 +00:00 |
|
|
|
dbdae85432
|
importinto, disttask: allow multi import job & adjust total memory for cgroup v2 (#51575)
ref pingcap/tidb#49008
|
2024-03-14 05:05:09 +00:00 |
|
|
|
b55c855142
|
importinto: fix incorrect index kv group count when table have common handle (#51615)
ref pingcap/tidb#50752
|
2024-03-08 07:06:36 +00:00 |
|
|
|
911bcf16a8
|
importinto: calculate writer mem size using step resource & add a option for test (#51486)
ref pingcap/tidb#49008
|
2024-03-07 10:59:06 +00:00 |
|
|
|
6566269a35
|
disttask: refresh whole task info when state/step changed (#51426)
ref pingcap/tidb#49008
|
2024-03-05 11:11:06 +00:00 |
|
|
|
4182a418c8
|
*: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
|
2024-02-29 07:42:31 +00:00 |
|
|
|
332086ebc8
|
importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
|
2024-02-27 09:05:09 +00:00 |
|
|
|
23190ff540
|
disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
|
2024-02-27 03:32:01 +00:00 |
|
|
|
a84d57c7da
|
disttask: extract task/subtask base (#51231)
ref pingcap/tidb#49008
|
2024-02-23 03:55:57 +00:00 |
|
|
|
e34702f10e
|
disttask: unify task order naming to 'rank' & refactor failpoint (#51136)
ref pingcap/tidb#49008
|
2024-02-21 03:37:57 +00:00 |
|
|
|
65d57c0a43
|
import into: log checksum for each KV group (#50871)
ref pingcap/tidb#50832
|
2024-02-18 08:55:55 +00:00 |
|
|
|
ba778070a2
|
external: onefile writer should have onClose, and add KV count to WriteSummary (#50955)
ref pingcap/tidb#50832
|
2024-02-04 09:32:43 +00:00 |
|
|
|
cac449b337
|
ddl, disttask: collect summary for each subtask (#50838)
ref pingcap/tidb#48795
|
2024-02-01 07:58:54 +00:00 |
|
|
|
b5542c5ed2
|
disttask: decouple handleExecutableTask from manager & separate executor context (#50724)
ref pingcap/tidb#49008
|
2024-01-30 05:22:52 +00:00 |
|
|
|
51e1e13494
|
*: update interface{} to any (#50770)
ref pingcap/tidb#50765
|
2024-01-29 07:21:29 +00:00 |
|
|
|
87ffb95856
|
disttask: replace spool with waitgroup (#50664)
ref pingcap/tidb#49008
|
2024-01-24 04:00:21 +00:00 |
|
|
|
7ce7fb2a85
|
external: round robin to use multiple GCS clients (#50408)
close pingcap/tidb#50413
|
2024-01-23 09:43:49 +00:00 |
|
