|
|
7639d9c48f
|
test: refine network port assignment in test (#65549)
|
2026-01-13 16:29:39 +00:00 |
|
|
|
28cce6a472
|
objstore: move s3 like store into separate pkg (#65513)
ref pingcap/tidb#65461
|
2026-01-12 10:01:26 +00:00 |
|
|
|
e0df5fdab0
|
objstore: encapsulate i/o related logic into separate pkg and refactor (#65495)
ref pingcap/tidb#65461
|
2026-01-09 14:22:32 +00:00 |
|
|
|
1e2cdaa16f
|
objstore: move from 'br/pkg' to 'pkg/' directory (#65462)
ref pingcap/tidb#65461
|
2026-01-08 08:50:47 +00:00 |
|
|
|
c342953b2d
|
dxf: rename the pkg from "disttask" to "dxf" (#65396)
ref pingcap/tidb#61702
|
2026-01-05 00:30:59 +00:00 |
|
|
|
62ee49c7b1
|
dxf: rename task concurrency to required slots and other refactor (#65195)
ref pingcap/tidb#65192
|
2025-12-25 05:07:47 +00:00 |
|
|
|
5e4e148f00
|
importinto: support conflict resolution in classic kernel (#65073)
ref pingcap/tidb#60621
|
2025-12-17 04:26:14 +00:00 |
|
|
|
28f2f4b1bc
|
importinto: add step executor for conflict resolution step (#64996)
ref pingcap/tidb#60621
|
2025-12-13 05:10:38 +00:00 |
|
|
|
8aefecd55c
|
sem: disable IMPORT INTO ... FROM SELECT ... for semv2 (#64984)
close pingcap/tidb#64983
|
2025-12-11 13:13:44 +00:00 |
|
|
|
e60489c452
|
importer: sample a portion of compressed files to speed up import spec generation (#64769)
close pingcap/tidb#64770
|
2025-12-11 10:31:17 +00:00 |
|
|
|
dc7e08f9c8
|
importinto: add helper methods and some type/enum definition for conflict resolve (#64956)
ref pingcap/tidb#60621
|
2025-12-11 06:35:02 +00:00 |
|
|
|
c49ac642c7
|
ddl/dxf: modify ingest param at runtime for add-index with global sort (#62120)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-12-08 10:47:14 +00:00 |
|
|
|
99a94f5b09
|
importinto: fix panic when field is missing for generated column (#64659)
close pingcap/tidb#64657
|
2025-11-25 08:49:56 +00:00 |
|
|
|
6eeb23e317
|
add-index/import-into: meter row and kv size data and disable some options for import-into in nextgen (#64584)
ref pingcap/tidb#61702
|
2025-11-20 16:29:44 +00:00 |
|
|
|
a51c19c1ff
|
planner, gcworker, executor: remove unused code (#64496)
close pingcap/tidb#61967
|
2025-11-19 10:57:44 +00:00 |
|
|
|
9e38acfdbf
|
dxf: make api request metering more accurate by intercepting request call (#64402)
ref pingcap/tidb#61702
|
2025-11-12 14:00:53 +00:00 |
|
|
|
779e298772
|
importinto/lightning: change library for parquet import (#63979)
ref pingcap/tidb#62906
|
2025-11-06 04:35:26 +00:00 |
|
|
|
bdd2b6f284
|
dxf/ddl: always enable DXF and fast reorg in nextgen (#64179)
ref pingcap/tidb#61702
|
2025-10-30 17:24:13 +00:00 |
|
|
|
eaf12833ea
|
importinto: fix some check and external-id not set after SEM v2 introduced (#64170)
ref pingcap/tidb#61702
|
2025-10-30 00:48:58 +00:00 |
|
|
|
3dd656d7da
|
importer: parallel init data source files (#63621)
close pingcap/tidb#62633
|
2025-10-15 10:18:47 +00:00 |
|
|
|
a4fda02ecb
|
importinto: disable some options when sem enabled (#63865)
ref pingcap/tidb#61702
|
2025-10-09 11:23:36 +00:00 |
|
|
|
579148dffb
|
importinto: enhance encode error msg (#63764)
close pingcap/tidb#63763
|
2025-09-26 04:01:43 +00:00 |
|
|
|
d6ca10af4f
|
importinto: sample files to get index size ratio in nextgen (#63695)
ref pingcap/tidb#61702
|
2025-09-24 09:00:37 +00:00 |
|
|
|
993231d213
|
test: fix some tests in nextgen (#63619)
ref pingcap/tidb#61702
|
2025-09-23 06:26:16 +00:00 |
|
|
|
b3011b689d
|
disttask: support metering on next-gen (#63397)
ref pingcap/tidb#61702
|
2025-09-19 02:27:35 +00:00 |
|
|
|
276ed0cf95
|
dxf: add api to manually tune the calculation of resource related params (#63517)
ref pingcap/tidb#61702
|
2025-09-18 15:09:53 +00:00 |
|
|
|
eb25197d68
|
disttask: collect metering data to subtask's real time summary (#63431)
ref pingcap/tidb#61702
|
2025-09-15 12:47:09 +00:00 |
|
|
|
941ba546bd
|
importinto: avoid cal resource params twice and round those params (#63452)
ref pingcap/tidb#61702
|
2025-09-11 08:19:15 +00:00 |
|
|
|
37f8a14657
|
importinto: fix zero update time during validation phase and refine logs (#63425)
ref pingcap/tidb#61702
|
2025-09-09 12:07:54 +00:00 |
|
|
|
bd5c194581
|
ImportInto: add import sdk for cloud (#61545)
ref pingcap/tidb#61264
|
2025-09-05 03:48:12 +00:00 |
|
|
|
cb95b10975
|
lightning, importer: determine whether to skip reading parquet based on the table structure (#62994)
close pingcap/tidb#63254
|
2025-09-04 07:58:21 +00:00 |
|
|
|
9825dfebc9
|
importinto: calculate distsql scan concurency in nextgen (#63341)
ref pingcap/tidb#61702
|
2025-09-03 11:52:06 +00:00 |
|
|
|
f76844ee28
|
test: fix some failed tests in nextgen (#63357)
ref pingcap/tidb#61702
|
2025-09-03 10:03:42 +00:00 |
|
|
|
8d1a00e351
|
importinto: update thread count after initialized data files (#63200)
ref pingcap/tidb#61702
|
2025-08-28 10:38:58 +00:00 |
|
|
|
aa875ea472
|
dxf: calculate max_node_count and concurrency for next-gen automatically (#62995)
ref pingcap/tidb#61702
|
2025-08-22 14:53:38 +00:00 |
|
|
|
8c88b61875
|
tests: fix unit tests for next-gen (#62895)
ref pingcap/tidb#61702
|
2025-08-20 19:51:02 +00:00 |
|
|
|
e2c6a416b4
|
importinto: use etcd client with keyspace during precheck and register task on nextgen (#63101)
ref pingcap/tidb#61702
|
2025-08-20 11:41:02 +00:00 |
|
|
|
658fa1a43e
|
crossks: add real-tikv tests for info schema sync (#63008)
ref pingcap/tidb#61702
|
2025-08-19 17:29:50 +00:00 |
|
|
|
259852d340
|
*: add the new SEMv2 config and implement most of the functions (#61634)
close pingcap/tidb#61582, close pingcap/tidb#61583, close pingcap/tidb#61584, close pingcap/tidb#61585
|
2025-08-18 13:38:47 +00:00 |
|
|
|
01bfccb1e8
|
importinto: add GROUP_KEY option to import jobs (#62369)
ref pingcap/tidb#61088
|
2025-08-15 03:22:51 +00:00 |
|
|
|
16ec21bcaa
|
importinto: redact option cloud_storage_uri in show process list and log (#62967)
close pingcap/tidb#62966
|
2025-08-14 06:06:30 +00:00 |
|
|
|
b6628ea835
|
ddl, disttask: import into integrate table mode (#61200)
close pingcap/tidb#61199
|
2025-08-11 09:02:45 +00:00 |
|
|
|
2f0bafe98b
|
util/etcd: remove useless code (#62833)
ref pingcap/tidb#59737
|
2025-08-05 09:52:27 +00:00 |
|
|
|
a9c4d868f5
|
*: add merge speed for global sort (#62550)
ref pingcap/tidb#61088
|
2025-07-25 05:57:13 +00:00 |
|
|
|
8060477c03
|
importinto: reduce def engine size to 100G and always use max node count to adjust subtask count (#62527)
ref pingcap/tidb#61702
|
2025-07-21 07:41:31 +00:00 |
|
|
|
e2a9f04ee7
|
disttask, importer: show more detailed progress in SHOW IMPORT JOBS (#62283)
ref pingcap/tidb#61088
|
2025-07-18 07:59:39 +00:00 |
|
|
|
3606de5c43
|
backend: add log fields for local and external pkg (#62476)
ref pingcap/tidb#61702
|
2025-07-18 05:49:42 +00:00 |
|
|
|
a712249d45
|
planner: move physical selection related logic into physical op (#62339)
ref pingcap/tidb#52714
|
2025-07-10 09:55:21 +00:00 |
|
|
|
5ec4f36c85
|
dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
|
2025-07-09 08:07:27 +00:00 |
|
|
|
0a704a4bb7
|
*: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
|
2025-07-04 15:12:30 +00:00 |
|
