|
|
e0df5fdab0
|
objstore: encapsulate i/o related logic into separate pkg and refactor (#65495)
ref pingcap/tidb#65461
|
2026-01-09 14:22:32 +00:00 |
|
|
|
1e2cdaa16f
|
objstore: move from 'br/pkg' to 'pkg/' directory (#65462)
ref pingcap/tidb#65461
|
2026-01-08 08:50:47 +00:00 |
|
|
|
c342953b2d
|
dxf: rename the pkg from "disttask" to "dxf" (#65396)
ref pingcap/tidb#61702
|
2026-01-05 00:30:59 +00:00 |
|
|
|
28f2f4b1bc
|
importinto: add step executor for conflict resolution step (#64996)
ref pingcap/tidb#60621
|
2025-12-13 05:10:38 +00:00 |
|
|
|
779e298772
|
importinto/lightning: change library for parquet import (#63979)
ref pingcap/tidb#62906
|
2025-11-06 04:35:26 +00:00 |
|
|
|
d6ca10af4f
|
importinto: sample files to get index size ratio in nextgen (#63695)
ref pingcap/tidb#61702
|
2025-09-24 09:00:37 +00:00 |
|
|
|
b3011b689d
|
disttask: support metering on next-gen (#63397)
ref pingcap/tidb#61702
|
2025-09-19 02:27:35 +00:00 |
|
|
|
cb95b10975
|
lightning, importer: determine whether to skip reading parquet based on the table structure (#62994)
close pingcap/tidb#63254
|
2025-09-04 07:58:21 +00:00 |
|
|
|
8c88b61875
|
tests: fix unit tests for next-gen (#62895)
ref pingcap/tidb#61702
|
2025-08-20 19:51:02 +00:00 |
|
|
|
b6628ea835
|
ddl, disttask: import into integrate table mode (#61200)
close pingcap/tidb#61199
|
2025-08-11 09:02:45 +00:00 |
|
|
|
3606de5c43
|
backend: add log fields for local and external pkg (#62476)
ref pingcap/tidb#61702
|
2025-07-18 05:49:42 +00:00 |
|
|
|
5ec4f36c85
|
dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
|
2025-07-09 08:07:27 +00:00 |
|
|
|
0a704a4bb7
|
*: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
|
2025-07-04 15:12:30 +00:00 |
|
|
|
b8a0d7f075
|
importinto: encode and ingest step use task keyspace in nextgen (#62138)
ref pingcap/tidb#61702
|
2025-07-03 17:46:45 +00:00 |
|
|
|
b8063d54f3
|
domain, executor: attach stats collector for IMPORT INTO sessions (#61849)
close pingcap/tidb#61922
|
2025-07-01 07:50:45 +00:00 |
|
|
|
8123a22d38
|
importinto: some prepare work for conflict resolve (#61426)
ref pingcap/tidb#60621
|
2025-06-10 12:21:59 +00:00 |
|
|
|
34afcbb9d3
|
executor: gopls modernize (#60787)
close pingcap/tidb#60786
|
2025-05-07 14:32:26 +00:00 |
|
|
|
23e5a09fd9
|
executor: tiny optimize import into from select performance (#60384)
ref pingcap/tidb#60377
|
2025-04-22 11:23:26 +00:00 |
|
|
|
08d20b8ee2
|
IMPORTINTO: close store inside LoadDataController (#60633)
close pingcap/tidb#60352
|
2025-04-18 11:18:52 +00:00 |
|
|
|
e2d5d1c017
|
import-into: support running with 1 thread when using global sort (#58572)
close pingcap/tidb#58680
|
2025-02-24 06:30:23 +00:00 |
|
|
|
cf4d252af8
|
*: split definition out of variable pkg and refactor some reorg methods (#59146)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-01-23 09:24:44 +00:00 |
|
|
|
bf939fa79a
|
*: don't handle live updates of column size (#58596)
close pingcap/tidb#58595
|
2025-01-06 19:42:49 +00:00 |
|
|
|
14a469ab9d
|
*: upgrade the PD client to adopt the latest refactor (#58440)
ref pingcap/tidb#58439
|
2024-12-23 10:36:12 +00:00 |
|
|
|
ecca340037
|
lightning: fix id too large after parallel import (#57398)
close pingcap/tidb#56814
|
2024-11-19 11:03:32 +00:00 |
|
|
|
5faeca4d1b
|
*: use golang built-in functions rather than mathutil (#56818)
close pingcap/tidb#56594
|
2024-10-25 05:18:17 +00:00 |
|
|
|
f383e0e685
|
ddl: add some comments to help readability (#52825)
|
2024-04-24 08:33:18 +00:00 |
|
|
|
72e5460ee8
|
lightning/importinto: fix insert err after import for AUTO_ID_CACHE=1 and SHARD_ROW_ID_BITS (#52712)
close pingcap/tidb#52654
|
2024-04-18 08:10:38 +00:00 |
|
|
|
f2ea18c07f
|
lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
|
2024-04-01 07:13:46 +00:00 |
|
|
|
40456f36fe
|
*: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
|
2024-03-25 11:59:17 +00:00 |
|
|
|
490e17c9ab
|
importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
|
2024-03-25 05:45:46 +00:00 |
|
|
|
5a2b8e8e1a
|
importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
|
2024-03-18 07:54:42 +00:00 |
|
|
|
ccc453bfe9
|
lightning: improve post-import conflict detection 'error' semantic (#51277)
ref pingcap/tidb#51036
|
2024-03-13 10:48:40 +00:00 |
|
|
|
911bcf16a8
|
importinto: calculate writer mem size using step resource & add a option for test (#51486)
ref pingcap/tidb#49008
|
2024-03-07 10:59:06 +00:00 |
|
|
|
4182a418c8
|
*: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
|
2024-02-29 07:42:31 +00:00 |
|
|
|
332086ebc8
|
importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
|
2024-02-27 09:05:09 +00:00 |
|
|
|
aca145b164
|
ddl, lightning: use TiDB PD client's discovery to create local backend (#51108)
close pingcap/tidb#51103
|
2024-02-18 10:55:55 +00:00 |
|
|
|
65d57c0a43
|
import into: log checksum for each KV group (#50871)
ref pingcap/tidb#50832
|
2024-02-18 08:55:55 +00:00 |
|
|
|
fdb13d1080
|
importinto: fix checksum always use default distsql-scan-concurrency (#50807)
close pingcap/tidb#50805
|
2024-01-30 06:33:22 +00:00 |
|
|
|
761b404fe2
|
executor: ChecksumTableExec respects SQLKiller (#50726)
close pingcap/tidb#50651
|
2024-01-26 03:39:28 +00:00 |
|
|
|
1db15879c1
|
importinto: add more test (#50558)
ref pingcap/tidb#49883
|
2024-01-22 05:00:19 +00:00 |
|
|
|
188726aec6
|
importinto: fix multiple pd addr (#50587)
close pingcap/tidb#50586
|
2024-01-19 06:19:47 +00:00 |
|
|
|
12d273e00f
|
importinto: executor part of import from select (#50341)
ref pingcap/tidb#49883
|
2024-01-17 15:52:47 +00:00 |
|
|
|
e87d94904a
|
lightning: always use PD HTTP client to access PD HTTP API (#50078)
ref pingcap/tidb#49865
|
2024-01-12 08:25:56 +00:00 |
|
|
|
e15c517afa
|
import/index: adjust concurrency using cpu-count of managed node depends on use case (#50091)
ref pingcap/tidb#49008
|
2024-01-10 08:31:54 +00:00 |
|
|
|
d791a79a3d
|
Lightning: support multiple PD addresses (#49516)
close pingcap/tidb#49515
|
2024-01-03 06:05:09 +00:00 |
|
|
|
89fc4403f3
|
Lightning : make pebbleDB block size configurable (#49514)
close pingcap/tidb#45037
|
2024-01-03 02:35:02 +00:00 |
|
|
|
84d9bc3b6a
|
importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
|
2023-12-29 07:27:35 +00:00 |
|
|
|
e392766f8e
|
importinto: calculate subtask count for global sort (#48169)
ref pingcap/tidb#47572
|
2023-11-03 02:59:17 +00:00 |
|
|
|
318e82bbb7
|
*: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
|
2023-10-13 14:36:26 +00:00 |
|
