Commit Graph

46 Commits

Author SHA1 Message Date
a712249d45 planner: move physical selection related logic into physical op (#62339)
ref pingcap/tidb#52714
2025-07-10 09:55:21 +00:00
0a704a4bb7 *: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
2025-07-04 15:12:30 +00:00
b8063d54f3 domain, executor: attach stats collector for IMPORT INTO sessions (#61849)
close pingcap/tidb#61922
2025-07-01 07:50:45 +00:00
8123a22d38 importinto: some prepare work for conflict resolve (#61426)
ref pingcap/tidb#60621
2025-06-10 12:21:59 +00:00
e315cff650 importinto: disable some feature for nextgen when sem enabled (#61370)
ref pingcap/tidb#60418
2025-05-29 06:17:55 +00:00
fe769f5154 dxf: include context info in the stored error (#61289)
close pingcap/tidb#60433
2025-05-23 13:28:13 +00:00
83edc07212 import into: automatic file type recognition based on file name characteristics (#59543)
close pingcap/tidb#59540
2025-05-23 06:39:29 +00:00
23e5a09fd9 executor: tiny optimize import into from select performance (#60384)
ref pingcap/tidb#60377
2025-04-22 11:23:26 +00:00
cc8d9cbbd4 lignthing/importinto: parallel reading files infos from data store (#59382)
close pingcap/tidb#56104, close pingcap/tidb#60224
2025-04-11 07:56:42 +00:00
d51e00e5bb globalsort: reduce number of SST ingested into TiKV (#59870) (#60045)
ref pingcap/tidb#51734, close pingcap/tidb#59962
2025-03-24 12:22:43 +00:00
9099090462 dxf: add tidb_max_dist_task_nodes to specify max node count (#58937)
close pingcap/tidb#58944
2025-02-18 05:12:25 +00:00
cf4d252af8 *: split definition out of variable pkg and refactor some reorg methods (#59146)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
2025-01-23 09:24:44 +00:00
b2f2faaa95 parser: move 'model' to 'ast' pkg (#58704)
ref pingcap/tidb#54436
2025-01-07 10:20:04 +00:00
bf939fa79a *: don't handle live updates of column size (#58596)
close pingcap/tidb#58595
2025-01-06 19:42:49 +00:00
14a469ab9d *: upgrade the PD client to adopt the latest refactor (#58440)
ref pingcap/tidb#58439
2024-12-23 10:36:12 +00:00
b9eeab4acc test: stabilize TestGetTargetNodeCpuCnt (#57823)
close pingcap/tidb#57822
2024-11-29 07:18:32 +00:00
Bin
5faeca4d1b *: use golang built-in functions rather than mathutil (#56818)
close pingcap/tidb#56594
2024-10-25 05:18:17 +00:00
a807829ed9 importinto: protect panic from encode loop (#56166)
ref pingcap/tidb#55970
2024-09-20 02:30:42 +00:00
68fdf55d94 *: rename some packages of context (#56108)
close pingcap/tidb#56107
2024-09-19 07:11:03 +00:00
3176b9c263 *: move XXInfo/Job, etc, out from model pkg in parser to meta (#55754)
ref pingcap/tidb#54436
2024-09-04 04:49:45 +00:00
4c23efb10b *: move annotated attributes of AST node to resolve.Context (#55634)
ref pingcap/tidb#54436
2024-08-29 13:39:01 +00:00
1f095a3f47 lighting: expose limited fields for kv.Session (#55517)
ref pingcap/tidb#53388
2024-08-20 14:34:42 +00:00
3368ccdef1 expression: introduce StaticEvalContext to provide context when evaluating expressions (#52631)
close pingcap/tidb#52630
2024-04-23 06:52:40 +00:00
5aa48d8284 planner: move base plan related output of core pkg and make it well-pkged (#52529)
ref pingcap/tidb#51664
2024-04-15 10:51:06 +00:00
f2ea18c07f lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
2024-04-01 07:13:46 +00:00
422ae46b6e lightning/br: move some common code into outer pkg (#52191)
ref pingcap/tidb#52182
2024-03-29 07:03:55 +00:00
40456f36fe *: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
2024-03-25 11:59:17 +00:00
490e17c9ab importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
2024-03-25 05:45:46 +00:00
5a2b8e8e1a importinto: pass kv store directly when rebase ids (#51850)
close pingcap/tidb#51848
2024-03-18 07:54:42 +00:00
4182a418c8 *: save kv.Storage in import disttask components and use it (#51336)
ref pingcap/tidb#51337
2024-02-29 07:42:31 +00:00
332086ebc8 importinto: remove separate wait routine in detached mode and refactor (#51335)
ref pingcap/tidb#49008
2024-02-27 09:05:09 +00:00
526d738207 expression: refactor functions to build expressions (#50997)
close pingcap/tidb#50996
2024-02-07 03:05:45 +00:00
9416934ea3 *: split planner errors and remove duplicate definitions (#50695)
ref pingcap/tidb#48875
2024-01-26 09:42:21 +00:00
761b404fe2 executor: ChecksumTableExec respects SQLKiller (#50726)
close pingcap/tidb#50651
2024-01-26 03:39:28 +00:00
1db15879c1 importinto: add more test (#50558)
ref pingcap/tidb#49883
2024-01-22 05:00:19 +00:00
12d273e00f importinto: executor part of import from select (#50341)
ref pingcap/tidb#49883
2024-01-17 15:52:47 +00:00
e87d94904a lightning: always use PD HTTP client to access PD HTTP API (#50078)
ref pingcap/tidb#49865
2024-01-12 08:25:56 +00:00
e15c517afa import/index: adjust concurrency using cpu-count of managed node depends on use case (#50091)
ref pingcap/tidb#49008
2024-01-10 08:31:54 +00:00
84d9bc3b6a importinto: move post-process code from disttask pkg to importer pkg (#49884)
ref pingcap/tidb#49883
2023-12-29 07:27:35 +00:00
323b0f772b *: remove deprecated LOAD DATA actions (#49470)
ref pingcap/tidb#44078
2023-12-15 14:00:21 +00:00
a7260ff598 disttask: impl slot manager in dispatcher, and check resource before start dispatcher (#49195)
close pingcap/tidb#49100
2023-12-11 13:49:48 +00:00
e392766f8e importinto: calculate subtask count for global sort (#48169)
ref pingcap/tidb#47572
2023-11-03 02:59:17 +00:00
1ba524c756 importinto: fix import compressed server file (#48173)
close pingcap/tidb#48049
2023-11-01 12:33:43 +00:00
99a4f35146 importinto: optimize write ingest step and fix oom (#48047)
ref pingcap/tidb#47572, close pingcap/tidb#47643
2023-10-31 11:48:38 +00:00
ab4c20ba16 importinto: revert "use one writer for each kv group for all concurrent encoder" (#47666)
ref pingcap/tidb#46704
2023-10-16 14:34:58 +00:00
318e82bbb7 *: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
2023-10-13 14:36:26 +00:00