|
|
78320d3169
|
dxf: separate runtime slots(concurrency) out of required slot to workaround OOM (#65265)
ref pingcap/tidb#65192
|
2025-12-26 08:26:07 +00:00 |
|
|
|
62ee49c7b1
|
dxf: rename task concurrency to required slots and other refactor (#65195)
ref pingcap/tidb#65192
|
2025-12-25 05:07:47 +00:00 |
|
|
|
5e4e148f00
|
importinto: support conflict resolution in classic kernel (#65073)
ref pingcap/tidb#60621
|
2025-12-17 04:26:14 +00:00 |
|
|
|
28f2f4b1bc
|
importinto: add step executor for conflict resolution step (#64996)
ref pingcap/tidb#60621
|
2025-12-13 05:10:38 +00:00 |
|
|
|
c5cd3e6a16
|
importinto: add bounded handle set for conflict resolution (#64844)
ref pingcap/tidb#60621
|
2025-12-04 06:59:41 +00:00 |
|
|
|
5e340159ca
|
importinto/addindex: log object storage access and range/region job key count (#64650)
ref pingcap/tidb#61702
|
2025-11-24 15:03:32 +00:00 |
|
|
|
4b2223cdd9
|
dxf: separate metered traffic into object storage and cluster and fix missing cluster traffic for import-into (#64523)
close pingcap/tidb#61702
|
2025-11-18 18:19:44 +00:00 |
|
|
|
c1247a0fc4
|
disttask: fix flaky summary collection for ingest step (#64471)
ref pingcap/tidb#61088
|
2025-11-17 09:31:05 +00:00 |
|
|
|
9e38acfdbf
|
dxf: make api request metering more accurate by intercepting request call (#64402)
ref pingcap/tidb#61702
|
2025-11-12 14:00:53 +00:00 |
|
|
|
82e2c6fd60
|
ddl/dxf: modify merge sort param at runtime for add-index with global sort (#62084)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-11-12 10:17:59 +00:00 |
|
|
|
63873b4c50
|
dxf: fix metering might be lost when failed to write, and refactor (#64358)
ref pingcap/tidb#61702
|
2025-11-10 13:48:17 +00:00 |
|
|
|
ee4eac2ccb
|
global sort: update the part size calculate formula to avoid upload multipart failed (#63918)
close pingcap/tidb#63781
|
2025-10-21 03:19:49 +00:00 |
|
|
|
b3011b689d
|
disttask: support metering on next-gen (#63397)
ref pingcap/tidb#61702
|
2025-09-19 02:27:35 +00:00 |
|
|
|
eb25197d68
|
disttask: collect metering data to subtask's real time summary (#63431)
ref pingcap/tidb#61702
|
2025-09-15 12:47:09 +00:00 |
|
|
|
37f8a14657
|
importinto: fix zero update time during validation phase and refine logs (#63425)
ref pingcap/tidb#61702
|
2025-09-09 12:07:54 +00:00 |
|
|
|
9cd2b03833
|
dxf/crossks: check by inner fields not global var and make crossks real tikvtest work (#62918)
ref pingcap/tidb#61702
|
2025-08-14 15:00:03 +00:00 |
|
|
|
b6628ea835
|
ddl, disttask: import into integrate table mode (#61200)
close pingcap/tidb#61199
|
2025-08-11 09:02:45 +00:00 |
|
|
|
2a0741939c
|
disttask: refine the speed calculation of import jobs (#62638)
ref pingcap/tidb#61088
|
2025-08-09 01:15:27 +00:00 |
|
|
|
a9c4d868f5
|
*: add merge speed for global sort (#62550)
ref pingcap/tidb#61088
|
2025-07-25 05:57:13 +00:00 |
|
|
|
5ec4f36c85
|
dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
|
2025-07-09 08:07:27 +00:00 |
|
|
|
0a704a4bb7
|
*: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
|
2025-07-04 15:12:30 +00:00 |
|
|
|
b8a0d7f075
|
importinto: encode and ingest step use task keyspace in nextgen (#62138)
ref pingcap/tidb#61702
|
2025-07-03 17:46:45 +00:00 |
|
|
|
8123a22d38
|
importinto: some prepare work for conflict resolve (#61426)
ref pingcap/tidb#60621
|
2025-06-10 12:21:59 +00:00 |
|
|
|
a165d9fd7c
|
import: adjust data mem buf block size based on max_entry_size_limit(#60139) (#61399)
close pingcap/tidb#61398
|
2025-06-09 03:38:43 +00:00 |
|
|
|
c71ebaf73e
|
global-sort: accelerate adding unique index using global sort (#60848)
ref pingcap/tidb#60621
|
2025-05-12 09:25:58 +00:00 |
|
|
|
5faa7496ef
|
ddl: fix OOM issue when adding many indexes (#60676)
ref pingcap/tidb#59508
|
2025-04-25 08:25:35 +00:00 |
|
|
|
08d20b8ee2
|
IMPORTINTO: close store inside LoadDataController (#60633)
close pingcap/tidb#60352
|
2025-04-18 11:18:52 +00:00 |
|
|
|
ed8b869a60
|
globalsort: write sorted kv meta to external storage (#59966)
close pingcap/tidb#60083
|
2025-03-26 09:39:54 +00:00 |
|
|
|
d51e00e5bb
|
globalsort: reduce number of SST ingested into TiKV (#59870) (#60045)
ref pingcap/tidb#51734, close pingcap/tidb#59962
|
2025-03-24 12:22:43 +00:00 |
|
|
|
435a716670
|
import: fix oom on global sort when the target table has large number of indices (#59518)
close pingcap/tidb#59508
|
2025-02-14 06:13:19 +00:00 |
|
|
|
bf939fa79a
|
*: don't handle live updates of column size (#58596)
close pingcap/tidb#58595
|
2025-01-06 19:42:49 +00:00 |
|
|
|
293077b761
|
dxf: support modify concurrency/task-specific-param for later subtask at task executor part (#58144)
ref pingcap/tidb#57497
|
2024-12-27 13:05:21 +00:00 |
|
|
|
3adc71cc71
|
dxf: merge OnFinished into RunSubtask (#58098)
ref pingcap/tidb#57497
|
2024-12-10 09:26:21 +00:00 |
|
|
|
ecca340037
|
lightning: fix id too large after parallel import (#57398)
close pingcap/tidb#56814
|
2024-11-19 11:03:32 +00:00 |
|
|
|
c65692b9b2
|
external: range job keys and region split keys are 2 concepts (part 1) (#55659)
ref pingcap/tidb#55374
|
2024-08-30 10:50:48 +00:00 |
|
|
|
ae9e196dae
|
workerpool: add TaskMayPanic interface to remind caller handles panic (#55537)
ref pingcap/tidb#55497
|
2024-08-21 07:27:12 +00:00 |
|
|
|
f46db203f9
|
*: caller can use a fixed TS for fast reorg (#52993)
close pingcap/tidb#46986, ref pingcap/tidb#49233
|
2024-05-10 13:31:09 +00:00 |
|
|
|
72e5460ee8
|
lightning/importinto: fix insert err after import for AUTO_ID_CACHE=1 and SHARD_ROW_ID_BITS (#52712)
close pingcap/tidb#52654
|
2024-04-18 08:10:38 +00:00 |
|
|
|
76abd8b836
|
disttask,ddl: use subtask concurrency (#52286)
ref pingcap/tidb#49008
|
2024-04-02 04:24:16 +00:00 |
|
|
|
f2ea18c07f
|
lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
|
2024-04-01 07:13:46 +00:00 |
|
|
|
ad63eb8d1e
|
disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
|
2024-03-29 04:20:19 +00:00 |
|
|
|
490e17c9ab
|
importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
|
2024-03-25 05:45:46 +00:00 |
|
|
|
df79e5ca11
|
globalsort: opt merge step mem to run on 8c (#51924)
ref pingcap/tidb#50752
|
2024-03-22 10:36:50 +00:00 |
|
|
|
61c471487e
|
globalsort: split files evenly in MergeOverlappingFiles (#51878)
ref pingcap/tidb#50752
|
2024-03-19 08:41:13 +00:00 |
|
|
|
5a2b8e8e1a
|
importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
|
2024-03-18 07:54:42 +00:00 |
|
|
|
911bcf16a8
|
importinto: calculate writer mem size using step resource & add a option for test (#51486)
ref pingcap/tidb#49008
|
2024-03-07 10:59:06 +00:00 |
|
|
|
4182a418c8
|
*: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
|
2024-02-29 07:42:31 +00:00 |
|
|
|
332086ebc8
|
importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
|
2024-02-27 09:05:09 +00:00 |
|
|
|
23190ff540
|
disttask: enlarge max-concurrent-task and optimize scheduler/executor loop (#51241)
ref pingcap/tidb#49008
|
2024-02-27 03:32:01 +00:00 |
|
|
|
65d57c0a43
|
import into: log checksum for each KV group (#50871)
ref pingcap/tidb#50832
|
2024-02-18 08:55:55 +00:00 |
|
