|
|
62ee49c7b1
|
dxf: rename task concurrency to required slots and other refactor (#65195)
ref pingcap/tidb#65192
|
2025-12-25 05:07:47 +00:00 |
|
|
|
9ee409cc4a
|
dxf: add event metric for cleanup or meter failure so we can add alert (#65124)
ref pingcap/tidb#61702
|
2025-12-19 09:06:41 +00:00 |
|
|
|
865730dd6e
|
dxf: retry failed write with the same TS instead of accumulating meter data to avoid duplicate data (#65115)
ref pingcap/tidb#61702
|
2025-12-18 18:18:17 +00:00 |
|
|
|
5e4e148f00
|
importinto: support conflict resolution in classic kernel (#65073)
ref pingcap/tidb#60621
|
2025-12-17 04:26:14 +00:00 |
|
|
|
6a1556e06e
|
dxf: add concurrency/max-node/duration to the final metering data to help estimate cost (#65039)
ref pingcap/tidb#61702
|
2025-12-16 18:41:47 +00:00 |
|
|
|
ee0a2f8cb8
|
importinto: add executor for conflict conflicts step (#65019)
ref pingcap/tidb#60621
|
2025-12-16 07:05:17 +00:00 |
|
|
|
28f2f4b1bc
|
importinto: add step executor for conflict resolution step (#64996)
ref pingcap/tidb#60621
|
2025-12-13 05:10:38 +00:00 |
|
|
|
f51be608ee
|
importinto: add doc for conflict resolve (#64987)
ref pingcap/tidb#60621
|
2025-12-12 09:00:54 +00:00 |
|
|
|
dc7e08f9c8
|
importinto: add helper methods and some type/enum definition for conflict resolve (#64956)
ref pingcap/tidb#60621
|
2025-12-11 06:35:02 +00:00 |
|
|
|
0dcf7ef696
|
importinto: add conflicted kv deleter (#64915)
ref pingcap/tidb#60621
|
2025-12-09 11:56:38 +00:00 |
|
|
|
ed787bf65b
|
importinto: add conflicted kv info collector (#64914)
ref pingcap/tidb#60621
|
2025-12-09 08:58:59 +00:00 |
|
|
|
3662bac9db
|
importinto: add conflicted KV handler (#64858)
ref pingcap/tidb#60621
|
2025-12-08 11:20:48 +00:00 |
|
|
|
c49ac642c7
|
ddl/dxf: modify ingest param at runtime for add-index with global sort (#62120)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-12-08 10:47:14 +00:00 |
|
|
|
45b1597860
|
dxf: fix meter data overflow if we register recorder of the same task again after unregister (#64861)
ref pingcap/tidb#61702
|
2025-12-05 07:29:38 +00:00 |
|
|
|
c5cd3e6a16
|
importinto: add bounded handle set for conflict resolution (#64844)
ref pingcap/tidb#60621
|
2025-12-04 06:59:41 +00:00 |
|
|
|
5e340159ca
|
importinto/addindex: log object storage access and range/region job key count (#64650)
ref pingcap/tidb#61702
|
2025-11-24 15:03:32 +00:00 |
|
|
|
be3d5b4b0f
|
*: flight recorder tracing for internal sessions (#64341)
ref pingcap/tidb#64008
|
2025-11-21 06:03:19 +00:00 |
|
|
|
6eeb23e317
|
add-index/import-into: meter row and kv size data and disable some options for import-into in nextgen (#64584)
ref pingcap/tidb#61702
|
2025-11-20 16:29:44 +00:00 |
|
|
|
17945b9a23
|
ingest: fix default region split size and keys in nextgen (#64540)
ref pingcap/tidb#61702, close pingcap/tidb#64526
|
2025-11-19 06:16:34 +00:00 |
|
|
|
4b2223cdd9
|
dxf: separate metered traffic into object storage and cluster and fix missing cluster traffic for import-into (#64523)
close pingcap/tidb#61702
|
2025-11-18 18:19:44 +00:00 |
|
|
|
c1247a0fc4
|
disttask: fix flaky summary collection for ingest step (#64471)
ref pingcap/tidb#61088
|
2025-11-17 09:31:05 +00:00 |
|
|
|
1a04b35a60
|
importinto: fix flaky test TestAutoDetectFileType (#64478)
close pingcap/tidb#64106
|
2025-11-14 06:53:38 +00:00 |
|
|
|
9e38acfdbf
|
dxf: make api request metering more accurate by intercepting request call (#64402)
ref pingcap/tidb#61702
|
2025-11-12 14:00:53 +00:00 |
|
|
|
82e2c6fd60
|
ddl/dxf: modify merge sort param at runtime for add-index with global sort (#62084)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-11-12 10:17:59 +00:00 |
|
|
|
f2abf53fab
|
ddl: add checkpoint operator for DXF local add index (#64171)
ref pingcap/tidb#62285
|
2025-11-11 10:58:02 +00:00 |
|
|
|
63873b4c50
|
dxf: fix metering might be lost when failed to write, and refactor (#64358)
ref pingcap/tidb#61702
|
2025-11-10 13:48:17 +00:00 |
|
|
|
5541db5f4b
|
dxf: fix incorrect worker count metric when total task count exceed schedule limit (#64321)
ref pingcap/tidb#61702
|
2025-11-06 13:31:29 +00:00 |
|
|
|
779e298772
|
importinto/lightning: change library for parquet import (#63979)
ref pingcap/tidb#62906
|
2025-11-06 04:35:26 +00:00 |
|
|
|
669341d8fb
|
disttask: fix wrong value displayed in SHOW IMPORT GROUP (#64090)
ref pingcap/tidb#61088
|
2025-11-05 08:42:56 +00:00 |
|
|
|
968e31fc3f
|
ddl: cancel the job context before rolling back (#64130)
close pingcap/tidb#64129
|
2025-10-31 01:47:37 +00:00 |
|
|
|
bdd2b6f284
|
dxf/ddl: always enable DXF and fast reorg in nextgen (#64179)
ref pingcap/tidb#61702
|
2025-10-30 17:24:13 +00:00 |
|
|
|
9dc8189afa
|
dxf: add metrics for alert purpose in nextgen (#64100)
ref pingcap/tidb#61702
|
2025-10-27 07:27:31 +00:00 |
|
|
|
ee4eac2ccb
|
global sort: update the part size calculate formula to avoid upload multipart failed (#63918)
close pingcap/tidb#63781
|
2025-10-21 03:19:49 +00:00 |
|
|
|
50a1e5a631
|
dxf: fix task cannot be cancelled when the number of active scheduler reached the limit (#63897)
ref pingcap/tidb#61702, close pingcap/tidb#63896
|
2025-10-11 03:38:21 +00:00 |
|
|
|
b6e32dd757
|
ddl: run merge-temp-index step on DXF (#62971)
close pingcap/tidb#63296
|
2025-10-03 10:15:04 +00:00 |
|
|
|
b3011b689d
|
disttask: support metering on next-gen (#63397)
ref pingcap/tidb#61702
|
2025-09-19 02:27:35 +00:00 |
|
|
|
276ed0cf95
|
dxf: add api to manually tune the calculation of resource related params (#63517)
ref pingcap/tidb#61702
|
2025-09-18 15:09:53 +00:00 |
|
|
|
eb25197d68
|
disttask: collect metering data to subtask's real time summary (#63431)
ref pingcap/tidb#61702
|
2025-09-15 12:47:09 +00:00 |
|
|
|
941ba546bd
|
importinto: avoid cal resource params twice and round those params (#63452)
ref pingcap/tidb#61702
|
2025-09-11 08:19:15 +00:00 |
|
|
|
37f8a14657
|
importinto: fix zero update time during validation phase and refine logs (#63425)
ref pingcap/tidb#61702
|
2025-09-09 12:07:54 +00:00 |
|
|
|
9825dfebc9
|
importinto: calculate distsql scan concurency in nextgen (#63341)
ref pingcap/tidb#61702
|
2025-09-03 11:52:06 +00:00 |
|
|
|
f76844ee28
|
test: fix some failed tests in nextgen (#63357)
ref pingcap/tidb#61702
|
2025-09-03 10:03:42 +00:00 |
|
|
|
72427c596e
|
importinto: update stats using UpdateStatsMeta (#63269)
ref pingcap/tidb#61702
|
2025-09-02 03:29:19 +00:00 |
|
|
|
8d1a00e351
|
importinto: update thread count after initialized data files (#63200)
ref pingcap/tidb#61702
|
2025-08-28 10:38:58 +00:00 |
|
|
|
a3d6d9ea49
|
importinto: store summary struct directly instad of byte slice (#63244)
ref pingcap/tidb#61088
|
2025-08-28 07:18:22 +00:00 |
|
|
|
36a2af4b10
|
dxf: start scheduler without reserve resource in nextgen (#63205)
ref pingcap/tidb#61702
|
2025-08-26 12:22:10 +00:00 |
|
|
|
97c5139bf9
|
dxf: add schedule status api for nextgen (#63159)
ref pingcap/tidb#61702
|
2025-08-25 10:45:07 +00:00 |
|
|
|
1fa4788853
|
dxf: prepare work for schedule status API in nextgen (#63140)
ref pingcap/tidb#61702
|
2025-08-22 17:21:38 +00:00 |
|
|
|
aa875ea472
|
dxf: calculate max_node_count and concurrency for next-gen automatically (#62995)
ref pingcap/tidb#61702
|
2025-08-22 14:53:38 +00:00 |
|
|
|
e2c6a416b4
|
importinto: use etcd client with keyspace during precheck and register task on nextgen (#63101)
ref pingcap/tidb#61702
|
2025-08-20 11:41:02 +00:00 |
|
