|
|
4b2223cdd9
|
dxf: separate metered traffic into object storage and cluster and fix missing cluster traffic for import-into (#64523)
close pingcap/tidb#61702
|
2025-11-18 18:19:44 +00:00 |
|
|
|
c1247a0fc4
|
disttask: fix flaky summary collection for ingest step (#64471)
ref pingcap/tidb#61088
|
2025-11-17 09:31:05 +00:00 |
|
|
|
8e799f74e9
|
ingest: skip write when the region has no leader (#64442)
ref pingcap/tidb#61702, close pingcap/tidb#64422
|
2025-11-13 11:33:35 +00:00 |
|
|
|
9e38acfdbf
|
dxf: make api request metering more accurate by intercepting request call (#64402)
ref pingcap/tidb#61702
|
2025-11-12 14:00:53 +00:00 |
|
|
|
82e2c6fd60
|
ddl/dxf: modify merge sort param at runtime for add-index with global sort (#62084)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-11-12 10:17:59 +00:00 |
|
|
|
779e298772
|
importinto/lightning: change library for parquet import (#63979)
ref pingcap/tidb#62906
|
2025-11-06 04:35:26 +00:00 |
|
|
|
f711b75a90
|
globalsort: export struct and fields to prepare for conflict resolution (#64283)
ref pingcap/tidb#60621
|
2025-11-05 15:03:14 +00:00 |
|
|
|
b2fc816077
|
backend: ensure engine cleanup to be executed (#64105)
close pingcap/tidb#64101
|
2025-10-29 11:14:16 +00:00 |
|
|
|
ee4eac2ccb
|
global sort: update the part size calculate formula to avoid upload multipart failed (#63918)
close pingcap/tidb#63781
|
2025-10-21 03:19:49 +00:00 |
|
|
|
ad823cc1ff
|
globalsort: add some test for one writer (#63972)
ref pingcap/tidb#60621
|
2025-10-15 11:07:31 +00:00 |
|
|
|
3dd656d7da
|
importer: parallel init data source files (#63621)
close pingcap/tidb#62633
|
2025-10-15 10:18:47 +00:00 |
|
|
|
8ea80e6b2b
|
lightning: increase source dir length (#63756)
close pingcap/tidb#63755
|
2025-09-25 12:33:46 +00:00 |
|
|
|
ef6f8e723e
|
ingest: adapt AddPartitionRange api for ingest (#63467)
close pingcap/tidb#63466
|
2025-09-23 16:54:37 +00:00 |
|
|
|
a8ef81a436
|
lightning: return error if missing trailing semicolon for lightning schema file (#63415)
close pingcap/tidb#63414
|
2025-09-23 10:23:16 +00:00 |
|
|
|
7b166f6d1d
|
localbackend: add some log to help diagnose (#63682)
ref pingcap/tidb#63681
|
2025-09-23 05:13:31 +00:00 |
|
|
|
eb25197d68
|
disttask: collect metering data to subtask's real time summary (#63431)
ref pingcap/tidb#61702
|
2025-09-15 12:47:09 +00:00 |
|
|
|
1f967030a0
|
fix: drop some dead code phase 1 (#63079)
ref pingcap/tidb#50727
|
2025-09-05 09:54:33 +00:00 |
|
|
|
bd5c194581
|
ImportInto: add import sdk for cloud (#61545)
ref pingcap/tidb#61264
|
2025-09-05 03:48:12 +00:00 |
|
|
|
cb95b10975
|
lightning, importer: determine whether to skip reading parquet based on the table structure (#62994)
close pingcap/tidb#63254
|
2025-09-04 07:58:21 +00:00 |
|
|
|
ba8710bea9
|
backend/local: add missing collector for next-gen ingest (#63178)
ref pingcap/tidb#61088
|
2025-08-27 04:44:28 +00:00 |
|
|
|
4f18d8d4b1
|
importinto: set request resource during checksum for nextgen (#63155)
ref pingcap/tidb#61702
|
2025-08-25 15:29:34 +00:00 |
|
|
|
fdca8155d1
|
global sort: reduce the memory usage of merge sort concurrent reader (#62921)
close pingcap/tidb#62853
|
2025-08-21 05:19:20 +00:00 |
|
|
|
6361402965
|
server/handler: register missing http handlers related to ingest param (#63099)
ref pingcap/tidb#61553
|
2025-08-21 03:41:29 +00:00 |
|
|
|
8c88b61875
|
tests: fix unit tests for next-gen (#62895)
ref pingcap/tidb#61702
|
2025-08-20 19:51:02 +00:00 |
|
|
|
3b96fe2123
|
perf: using generics instead of reflect for better performance (#62973)
close pingcap/tidb#62972
|
2025-08-20 18:04:01 +00:00 |
|
|
|
92e64b2699
|
global_sort: fix incorrect write speed metrics in merge-sort step (#62847)
close pingcap/tidb#62870
|
2025-08-14 15:39:51 +00:00 |
|
|
|
b529ae5267
|
globalsort: use partitioned prefix to store intermediate files (#62905)
close pingcap/tidb#62904
|
2025-08-12 07:08:42 +00:00 |
|
|
|
6f38f974a3
|
tests: fix realtikv test for next-gen (#62701)
close pingcap/tidb#60688, ref pingcap/tidb#61702
|
2025-08-06 08:14:15 +00:00 |
|
|
|
a9c4d868f5
|
*: add merge speed for global sort (#62550)
ref pingcap/tidb#61088
|
2025-07-25 05:57:13 +00:00 |
|
|
|
06674e2309
|
*: adjusts the merge sort overlap threshold/merge sort file count step based on concurrency (#62483)
close pingcap/tidb#60951
|
2025-07-24 17:01:07 +00:00 |
|
|
|
f2534055f2
|
ddl: send result chunks to writers after scan task complete (#62014)
close pingcap/tidb#62008
|
2025-07-18 12:01:49 +00:00 |
|
|
|
3606de5c43
|
backend: add log fields for local and external pkg (#62476)
ref pingcap/tidb#61702
|
2025-07-18 05:49:42 +00:00 |
|
|
|
65c3cf222d
|
globalsort: fix stuck when ingesting small kv (#62407)
close pingcap/tidb#62388
|
2025-07-15 04:37:06 +00:00 |
|
|
|
5ec4f36c85
|
dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
|
2025-07-09 08:07:27 +00:00 |
|
|
|
86ed1cab62
|
backend/local: add rate limiter for split region and ingest data (#61555)
close pingcap/tidb#61553
|
2025-07-05 09:30:09 +00:00 |
|
|
|
0a704a4bb7
|
*: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
|
2025-07-04 15:12:30 +00:00 |
|
|
|
dea3e1e7f6
|
retry: enhance retry for ingestor on nextgen (#62191)
ref pingcap/tidb#61702
|
2025-07-03 17:46:52 +00:00 |
|
|
|
6106300325
|
localbackend: release the service safe point on finish checksum (#62143)
ref pingcap/tidb#61702, close pingcap/tidb#62142
|
2025-07-02 13:45:42 +00:00 |
|
|
|
02757471f1
|
statistics, lightning: remove useless code (#62004)
|
2025-06-26 03:07:36 +00:00 |
|
|
|
ad86c9777c
|
lightning: fix length check may be skipped for first line (#61874)
close pingcap/tidb#61873
|
2025-06-24 03:39:48 +00:00 |
|
|
|
8123a22d38
|
importinto: some prepare work for conflict resolve (#61426)
ref pingcap/tidb#60621
|
2025-06-10 12:21:59 +00:00 |
|
|
|
a165d9fd7c
|
import: adjust data mem buf block size based on max_entry_size_limit(#60139) (#61399)
close pingcap/tidb#61398
|
2025-06-09 03:38:43 +00:00 |
|
|
|
cc0925eeaf
|
Lightning: Attempt to return writeTooSlow when we experience write timeout. (#61346)
ref pingcap/tidb#61326
|
2025-06-06 07:09:45 +00:00 |
|
|
|
d216b7be1a
|
ingestor: fix reused httpclient schema and move ingest api err to ingestcli pkg (#61492)
ref pingcap/tidb#60418
|
2025-06-05 13:10:44 +00:00 |
|
|
|
029c0a90d0
|
*: inject random error for global sort & injest (#60582)
close pingcap/tidb#60277
|
2025-06-04 11:29:23 +00:00 |
|
|
|
d0369ffcec
|
ingestor: reuse http client and close idle connections on localbackend close for nextgen (#61473)
ref pingcap/tidb#60418
|
2025-06-04 05:12:05 +00:00 |
|
|
|
d1e09c73fb
|
executor: tiny optimize import into from select performance by avoid 1 cast and memory allocation (#60397)
close pingcap/tidb#60373
|
2025-05-30 05:34:58 +00:00 |
|
|
|
684010c999
|
external: fix the dead loop in readNBytes (#61309)
close pingcap/tidb#61177
|
2025-05-29 11:16:19 +00:00 |
|
|
|
3ab8c7fe85
|
importinto: forbid set external-id explicitly and set it to keyspace name when sem enabled on nextgen (#61315)
ref pingcap/tidb#60418
|
2025-05-26 08:14:19 +00:00 |
|
|
|
5a00a10d38
|
disttask: distribute merge sort subtasks to all available nodes (#60395)
close pingcap/tidb#60375
|
2025-05-24 04:21:07 +00:00 |
|
