|
|
779e298772
|
importinto/lightning: change library for parquet import (#63979)
ref pingcap/tidb#62906
|
2025-11-06 04:35:26 +00:00 |
|
|
|
669341d8fb
|
disttask: fix wrong value displayed in SHOW IMPORT GROUP (#64090)
ref pingcap/tidb#61088
|
2025-11-05 08:42:56 +00:00 |
|
|
|
9dc8189afa
|
dxf: add metrics for alert purpose in nextgen (#64100)
ref pingcap/tidb#61702
|
2025-10-27 07:27:31 +00:00 |
|
|
|
ee4eac2ccb
|
global sort: update the part size calculate formula to avoid upload multipart failed (#63918)
close pingcap/tidb#63781
|
2025-10-21 03:19:49 +00:00 |
|
|
|
b3011b689d
|
disttask: support metering on next-gen (#63397)
ref pingcap/tidb#61702
|
2025-09-19 02:27:35 +00:00 |
|
|
|
276ed0cf95
|
dxf: add api to manually tune the calculation of resource related params (#63517)
ref pingcap/tidb#61702
|
2025-09-18 15:09:53 +00:00 |
|
|
|
eb25197d68
|
disttask: collect metering data to subtask's real time summary (#63431)
ref pingcap/tidb#61702
|
2025-09-15 12:47:09 +00:00 |
|
|
|
37f8a14657
|
importinto: fix zero update time during validation phase and refine logs (#63425)
ref pingcap/tidb#61702
|
2025-09-09 12:07:54 +00:00 |
|
|
|
72427c596e
|
importinto: update stats using UpdateStatsMeta (#63269)
ref pingcap/tidb#61702
|
2025-09-02 03:29:19 +00:00 |
|
|
|
8d1a00e351
|
importinto: update thread count after initialized data files (#63200)
ref pingcap/tidb#61702
|
2025-08-28 10:38:58 +00:00 |
|
|
|
a3d6d9ea49
|
importinto: store summary struct directly instad of byte slice (#63244)
ref pingcap/tidb#61088
|
2025-08-28 07:18:22 +00:00 |
|
|
|
36a2af4b10
|
dxf: start scheduler without reserve resource in nextgen (#63205)
ref pingcap/tidb#61702
|
2025-08-26 12:22:10 +00:00 |
|
|
|
e2c6a416b4
|
importinto: use etcd client with keyspace during precheck and register task on nextgen (#63101)
ref pingcap/tidb#61702
|
2025-08-20 11:41:02 +00:00 |
|
|
|
658fa1a43e
|
crossks: add real-tikv tests for info schema sync (#63008)
ref pingcap/tidb#61702
|
2025-08-19 17:29:50 +00:00 |
|
|
|
d82d2baa0f
|
bazel: update settings and close some race on tests (#63009)
|
2025-08-15 09:07:31 +00:00 |
|
|
|
01bfccb1e8
|
importinto: add GROUP_KEY option to import jobs (#62369)
ref pingcap/tidb#61088
|
2025-08-15 03:22:51 +00:00 |
|
|
|
9cd2b03833
|
dxf/crossks: check by inner fields not global var and make crossks real tikvtest work (#62918)
ref pingcap/tidb#61702
|
2025-08-14 15:00:03 +00:00 |
|
|
|
b529ae5267
|
globalsort: use partitioned prefix to store intermediate files (#62905)
close pingcap/tidb#62904
|
2025-08-12 07:08:42 +00:00 |
|
|
|
b6628ea835
|
ddl, disttask: import into integrate table mode (#61200)
close pingcap/tidb#61199
|
2025-08-11 09:02:45 +00:00 |
|
|
|
2a0741939c
|
disttask: refine the speed calculation of import jobs (#62638)
ref pingcap/tidb#61088
|
2025-08-09 01:15:27 +00:00 |
|
|
|
2f0bafe98b
|
util/etcd: remove useless code (#62833)
ref pingcap/tidb#59737
|
2025-08-05 09:52:27 +00:00 |
|
|
|
ce8dbdab53
|
*: use difference port to fix UT (#62624)
close pingcap/tidb#62623
|
2025-07-26 15:51:50 +00:00 |
|
|
|
1ea1db40cd
|
infosync: move server info sync part of structs out to a separate pkg (#62609)
ref pingcap/tidb#61702
|
2025-07-25 07:46:59 +00:00 |
|
|
|
a9c4d868f5
|
*: add merge speed for global sort (#62550)
ref pingcap/tidb#61088
|
2025-07-25 05:57:13 +00:00 |
|
|
|
06674e2309
|
*: adjusts the merge sort overlap threshold/merge sort file count step based on concurrency (#62483)
close pingcap/tidb#60951
|
2025-07-24 17:01:07 +00:00 |
|
|
|
8060477c03
|
importinto: reduce def engine size to 100G and always use max node count to adjust subtask count (#62527)
ref pingcap/tidb#61702
|
2025-07-21 07:41:31 +00:00 |
|
|
|
e2a9f04ee7
|
disttask, importer: show more detailed progress in SHOW IMPORT JOBS (#62283)
ref pingcap/tidb#61088
|
2025-07-18 07:59:39 +00:00 |
|
|
|
3606de5c43
|
backend: add log fields for local and external pkg (#62476)
ref pingcap/tidb#61702
|
2025-07-18 05:49:42 +00:00 |
|
|
|
5ec4f36c85
|
dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
|
2025-07-09 08:07:27 +00:00 |
|
|
|
0a704a4bb7
|
*: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
|
2025-07-04 15:12:30 +00:00 |
|
|
|
b8a0d7f075
|
importinto: encode and ingest step use task keyspace in nextgen (#62138)
ref pingcap/tidb#61702
|
2025-07-03 17:46:45 +00:00 |
|
|
|
a90774c2e5
|
testkit: make ut works in nextgen after introduce SYSTEM ks (#62113)
ref pingcap/tidb#61702
|
2025-07-01 10:20:55 +00:00 |
|
|
|
ae70341a13
|
disttask, util: remove useless code (#62056)
|
2025-06-30 07:05:18 +00:00 |
|
|
|
704373b1e4
|
importinto: use correct session to submit/update/query task in DXF service (#62023)
ref pingcap/tidb#61702
|
2025-06-28 06:07:21 +00:00 |
|
|
|
ffaec74aed
|
disttask: add keyspace name to task_key for next-gen (#61860)
ref pingcap/tidb#61702
|
2025-06-22 13:12:39 +00:00 |
|
|
|
8123a22d38
|
importinto: some prepare work for conflict resolve (#61426)
ref pingcap/tidb#60621
|
2025-06-10 12:21:59 +00:00 |
|
|
|
a165d9fd7c
|
import: adjust data mem buf block size based on max_entry_size_limit(#60139) (#61399)
close pingcap/tidb#61398
|
2025-06-09 03:38:43 +00:00 |
|
|
|
5a00a10d38
|
disttask: distribute merge sort subtasks to all available nodes (#60395)
close pingcap/tidb#60375
|
2025-05-24 04:21:07 +00:00 |
|
|
|
c71ebaf73e
|
global-sort: accelerate adding unique index using global sort (#60848)
ref pingcap/tidb#60621
|
2025-05-12 09:25:58 +00:00 |
|
|
|
dc876e5c51
|
disttask: gopls modernize (#60795)
close pingcap/tidb#60794
|
2025-04-28 10:06:26 +00:00 |
|
|
|
0200e5d634
|
localbackend: merge feature branch next-gen (#60879)
ref pingcap/tidb#60418
|
2025-04-28 05:18:58 +00:00 |
|
|
|
5faa7496ef
|
ddl: fix OOM issue when adding many indexes (#60676)
ref pingcap/tidb#59508
|
2025-04-25 08:25:35 +00:00 |
|
|
|
08d20b8ee2
|
IMPORTINTO: close store inside LoadDataController (#60633)
close pingcap/tidb#60352
|
2025-04-18 11:18:52 +00:00 |
|
|
|
813b32f4df
|
import: add a hidden option to enable manual recover for debug purpose (#59674)
ref pingcap/tidb#59640
|
2025-04-08 08:46:48 +00:00 |
|
|
|
f6f5703e43
|
importinto: fix error not returned when writing external meta (#60350)
close pingcap/tidb#60083
|
2025-04-01 09:04:15 +00:00 |
|
|
|
6e5a6d2a93
|
importinto: check retryable schedule error (#60320)
ref pingcap/tidb#59754
|
2025-03-28 11:50:24 +00:00 |
|
|
|
ed8b869a60
|
globalsort: write sorted kv meta to external storage (#59966)
close pingcap/tidb#60083
|
2025-03-26 09:39:54 +00:00 |
|
|
|
b08a92082f
|
disttask: fix task metrics for distributed execute framework panel (#59940)
ref pingcap/tidb#47017
|
2025-03-25 17:31:28 +00:00 |
|
|
|
d51e00e5bb
|
globalsort: reduce number of SST ingested into TiKV (#59870) (#60045)
ref pingcap/tidb#51734, close pingcap/tidb#59962
|
2025-03-24 12:22:43 +00:00 |
|
|
|
80d6b5683c
|
infosync: refactor server config into dynamic and static sections (#58473)
close pingcap/tidb#58405
|
2025-03-18 02:36:52 +00:00 |
|
