|
|
bd5c194581
|
ImportInto: add import sdk for cloud (#61545)
ref pingcap/tidb#61264
|
2025-09-05 03:48:12 +00:00 |
|
|
|
cb95b10975
|
lightning, importer: determine whether to skip reading parquet based on the table structure (#62994)
close pingcap/tidb#63254
|
2025-09-04 07:58:21 +00:00 |
|
|
|
9825dfebc9
|
importinto: calculate distsql scan concurency in nextgen (#63341)
ref pingcap/tidb#61702
|
2025-09-03 11:52:06 +00:00 |
|
|
|
f76844ee28
|
test: fix some failed tests in nextgen (#63357)
ref pingcap/tidb#61702
|
2025-09-03 10:03:42 +00:00 |
|
|
|
8d1a00e351
|
importinto: update thread count after initialized data files (#63200)
ref pingcap/tidb#61702
|
2025-08-28 10:38:58 +00:00 |
|
|
|
aa875ea472
|
dxf: calculate max_node_count and concurrency for next-gen automatically (#62995)
ref pingcap/tidb#61702
|
2025-08-22 14:53:38 +00:00 |
|
|
|
8c88b61875
|
tests: fix unit tests for next-gen (#62895)
ref pingcap/tidb#61702
|
2025-08-20 19:51:02 +00:00 |
|
|
|
e2c6a416b4
|
importinto: use etcd client with keyspace during precheck and register task on nextgen (#63101)
ref pingcap/tidb#61702
|
2025-08-20 11:41:02 +00:00 |
|
|
|
658fa1a43e
|
crossks: add real-tikv tests for info schema sync (#63008)
ref pingcap/tidb#61702
|
2025-08-19 17:29:50 +00:00 |
|
|
|
259852d340
|
*: add the new SEMv2 config and implement most of the functions (#61634)
close pingcap/tidb#61582, close pingcap/tidb#61583, close pingcap/tidb#61584, close pingcap/tidb#61585
|
2025-08-18 13:38:47 +00:00 |
|
|
|
01bfccb1e8
|
importinto: add GROUP_KEY option to import jobs (#62369)
ref pingcap/tidb#61088
|
2025-08-15 03:22:51 +00:00 |
|
|
|
16ec21bcaa
|
importinto: redact option cloud_storage_uri in show process list and log (#62967)
close pingcap/tidb#62966
|
2025-08-14 06:06:30 +00:00 |
|
|
|
b6628ea835
|
ddl, disttask: import into integrate table mode (#61200)
close pingcap/tidb#61199
|
2025-08-11 09:02:45 +00:00 |
|
|
|
2f0bafe98b
|
util/etcd: remove useless code (#62833)
ref pingcap/tidb#59737
|
2025-08-05 09:52:27 +00:00 |
|
|
|
a9c4d868f5
|
*: add merge speed for global sort (#62550)
ref pingcap/tidb#61088
|
2025-07-25 05:57:13 +00:00 |
|
|
|
8060477c03
|
importinto: reduce def engine size to 100G and always use max node count to adjust subtask count (#62527)
ref pingcap/tidb#61702
|
2025-07-21 07:41:31 +00:00 |
|
|
|
e2a9f04ee7
|
disttask, importer: show more detailed progress in SHOW IMPORT JOBS (#62283)
ref pingcap/tidb#61088
|
2025-07-18 07:59:39 +00:00 |
|
|
|
3606de5c43
|
backend: add log fields for local and external pkg (#62476)
ref pingcap/tidb#61702
|
2025-07-18 05:49:42 +00:00 |
|
|
|
a712249d45
|
planner: move physical selection related logic into physical op (#62339)
ref pingcap/tidb#52714
|
2025-07-10 09:55:21 +00:00 |
|
|
|
5ec4f36c85
|
dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
|
2025-07-09 08:07:27 +00:00 |
|
|
|
0a704a4bb7
|
*: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
|
2025-07-04 15:12:30 +00:00 |
|
|
|
b8a0d7f075
|
importinto: encode and ingest step use task keyspace in nextgen (#62138)
ref pingcap/tidb#61702
|
2025-07-03 17:46:45 +00:00 |
|
|
|
b8063d54f3
|
domain, executor: attach stats collector for IMPORT INTO sessions (#61849)
close pingcap/tidb#61922
|
2025-07-01 07:50:45 +00:00 |
|
|
|
1abbbf02de
|
session: rename GetDomainInfoSchema to GetLatestInfoSchema (#61894)
ref pingcap/tidb#61702
|
2025-06-23 10:09:21 +00:00 |
|
|
|
8123a22d38
|
importinto: some prepare work for conflict resolve (#61426)
ref pingcap/tidb#60621
|
2025-06-10 12:21:59 +00:00 |
|
|
|
292c2c5caf
|
global sort: use cluster id in file path (#61502)
close pingcap/tidb#61537
|
2025-06-10 06:34:40 +00:00 |
|
|
|
fa3c79b408
|
br: enable parallel restore (#58724)
close pingcap/tidb#58725
|
2025-06-03 02:36:14 +00:00 |
|
|
|
d1e09c73fb
|
executor: tiny optimize import into from select performance by avoid 1 cast and memory allocation (#60397)
close pingcap/tidb#60373
|
2025-05-30 05:34:58 +00:00 |
|
|
|
e315cff650
|
importinto: disable some feature for nextgen when sem enabled (#61370)
ref pingcap/tidb#60418
|
2025-05-29 06:17:55 +00:00 |
|
|
|
3ab8c7fe85
|
importinto: forbid set external-id explicitly and set it to keyspace name when sem enabled on nextgen (#61315)
ref pingcap/tidb#60418
|
2025-05-26 08:14:19 +00:00 |
|
|
|
fe769f5154
|
dxf: include context info in the stored error (#61289)
close pingcap/tidb#60433
|
2025-05-23 13:28:13 +00:00 |
|
|
|
83edc07212
|
import into: automatic file type recognition based on file name characteristics (#59543)
close pingcap/tidb#59540
|
2025-05-23 06:39:29 +00:00 |
|
|
|
34afcbb9d3
|
executor: gopls modernize (#60787)
close pingcap/tidb#60786
|
2025-05-07 14:32:26 +00:00 |
|
|
|
0200e5d634
|
localbackend: merge feature branch next-gen (#60879)
ref pingcap/tidb#60418
|
2025-04-28 05:18:58 +00:00 |
|
|
|
23e5a09fd9
|
executor: tiny optimize import into from select performance (#60384)
ref pingcap/tidb#60377
|
2025-04-22 11:23:26 +00:00 |
|
|
|
08d20b8ee2
|
IMPORTINTO: close store inside LoadDataController (#60633)
close pingcap/tidb#60352
|
2025-04-18 11:18:52 +00:00 |
|
|
|
cc8d9cbbd4
|
lignthing/importinto: parallel reading files infos from data store (#59382)
close pingcap/tidb#56104, close pingcap/tidb#60224
|
2025-04-11 07:56:42 +00:00 |
|
|
|
813b32f4df
|
import: add a hidden option to enable manual recover for debug purpose (#59674)
ref pingcap/tidb#59640
|
2025-04-08 08:46:48 +00:00 |
|
|
|
fe5a5175a1
|
importinto: disable switching to 'import mode' when global sort (#60363)
close pingcap/tidb#60361
|
2025-04-02 11:00:50 +00:00 |
|
|
|
f3d0e43040
|
*: upgrade to the latest client-go (#59757)
ref pingcap/tidb#58780
|
2025-03-27 07:32:36 +00:00 |
|
|
|
d51e00e5bb
|
globalsort: reduce number of SST ingested into TiKV (#59870) (#60045)
ref pingcap/tidb#51734, close pingcap/tidb#59962
|
2025-03-24 12:22:43 +00:00 |
|
|
|
e2d5d1c017
|
import-into: support running with 1 thread when using global sort (#58572)
close pingcap/tidb#58680
|
2025-02-24 06:30:23 +00:00 |
|
|
|
4db34bc3e2
|
workload-based learning: save the metrics and create new workload_values table (#59126)
ref pingcap/tidb#58131
|
2025-02-20 03:58:34 +00:00 |
|
|
|
9099090462
|
dxf: add tidb_max_dist_task_nodes to specify max node count (#58937)
close pingcap/tidb#58944
|
2025-02-18 05:12:25 +00:00 |
|
|
|
81995d6892
|
csv-parser: rename fields to better reflect its meaning (#59360)
ref pingcap/tidb#44893, ref pingcap/tidb#57275
|
2025-02-11 05:25:19 +00:00 |
|
|
|
cf4d252af8
|
*: split definition out of variable pkg and refactor some reorg methods (#59146)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-01-23 09:24:44 +00:00 |
|
|
|
b2f2faaa95
|
parser: move 'model' to 'ast' pkg (#58704)
ref pingcap/tidb#54436
|
2025-01-07 10:20:04 +00:00 |
|
|
|
bf939fa79a
|
*: don't handle live updates of column size (#58596)
close pingcap/tidb#58595
|
2025-01-06 19:42:49 +00:00 |
|
|
|
14a469ab9d
|
*: upgrade the PD client to adopt the latest refactor (#58440)
ref pingcap/tidb#58439
|
2024-12-23 10:36:12 +00:00 |
|
|
|
b9eeab4acc
|
test: stabilize TestGetTargetNodeCpuCnt (#57823)
close pingcap/tidb#57822
|
2024-11-29 07:18:32 +00:00 |
|