|
|
a9c4d868f5
|
*: add merge speed for global sort (#62550)
ref pingcap/tidb#61088
|
2025-07-25 05:57:13 +00:00 |
|
|
|
06674e2309
|
*: adjusts the merge sort overlap threshold/merge sort file count step based on concurrency (#62483)
close pingcap/tidb#60951
|
2025-07-24 17:01:07 +00:00 |
|
|
|
f2534055f2
|
ddl: send result chunks to writers after scan task complete (#62014)
close pingcap/tidb#62008
|
2025-07-18 12:01:49 +00:00 |
|
|
|
3606de5c43
|
backend: add log fields for local and external pkg (#62476)
ref pingcap/tidb#61702
|
2025-07-18 05:49:42 +00:00 |
|
|
|
65c3cf222d
|
globalsort: fix stuck when ingesting small kv (#62407)
close pingcap/tidb#62388
|
2025-07-15 04:37:06 +00:00 |
|
|
|
5ec4f36c85
|
dxf: use correct store in add-index, checksum by copr in import-into, and enable DXF service (#62224)
ref pingcap/tidb#61702
|
2025-07-09 08:07:27 +00:00 |
|
|
|
86ed1cab62
|
backend/local: add rate limiter for split region and ingest data (#61555)
close pingcap/tidb#61553
|
2025-07-05 09:30:09 +00:00 |
|
|
|
0a704a4bb7
|
*: collect subtask summary for IMPORT INTO tasks (#61600)
ref pingcap/tidb#61088
|
2025-07-04 15:12:30 +00:00 |
|
|
|
dea3e1e7f6
|
retry: enhance retry for ingestor on nextgen (#62191)
ref pingcap/tidb#61702
|
2025-07-03 17:46:52 +00:00 |
|
|
|
6106300325
|
localbackend: release the service safe point on finish checksum (#62143)
ref pingcap/tidb#61702, close pingcap/tidb#62142
|
2025-07-02 13:45:42 +00:00 |
|
|
|
02757471f1
|
statistics, lightning: remove useless code (#62004)
|
2025-06-26 03:07:36 +00:00 |
|
|
|
ad86c9777c
|
lightning: fix length check may be skipped for first line (#61874)
close pingcap/tidb#61873
|
2025-06-24 03:39:48 +00:00 |
|
|
|
8123a22d38
|
importinto: some prepare work for conflict resolve (#61426)
ref pingcap/tidb#60621
|
2025-06-10 12:21:59 +00:00 |
|
|
|
a165d9fd7c
|
import: adjust data mem buf block size based on max_entry_size_limit(#60139) (#61399)
close pingcap/tidb#61398
|
2025-06-09 03:38:43 +00:00 |
|
|
|
cc0925eeaf
|
Lightning: Attempt to return writeTooSlow when we experience write timeout. (#61346)
ref pingcap/tidb#61326
|
2025-06-06 07:09:45 +00:00 |
|
|
|
d216b7be1a
|
ingestor: fix reused httpclient schema and move ingest api err to ingestcli pkg (#61492)
ref pingcap/tidb#60418
|
2025-06-05 13:10:44 +00:00 |
|
|
|
029c0a90d0
|
*: inject random error for global sort & injest (#60582)
close pingcap/tidb#60277
|
2025-06-04 11:29:23 +00:00 |
|
|
|
d0369ffcec
|
ingestor: reuse http client and close idle connections on localbackend close for nextgen (#61473)
ref pingcap/tidb#60418
|
2025-06-04 05:12:05 +00:00 |
|
|
|
d1e09c73fb
|
executor: tiny optimize import into from select performance by avoid 1 cast and memory allocation (#60397)
close pingcap/tidb#60373
|
2025-05-30 05:34:58 +00:00 |
|
|
|
684010c999
|
external: fix the dead loop in readNBytes (#61309)
close pingcap/tidb#61177
|
2025-05-29 11:16:19 +00:00 |
|
|
|
3ab8c7fe85
|
importinto: forbid set external-id explicitly and set it to keyspace name when sem enabled on nextgen (#61315)
ref pingcap/tidb#60418
|
2025-05-26 08:14:19 +00:00 |
|
|
|
5a00a10d38
|
disttask: distribute merge sort subtasks to all available nodes (#60395)
close pingcap/tidb#60375
|
2025-05-24 04:21:07 +00:00 |
|
|
|
e9853fe210
|
br: enable follower handler again (#60301)
close pingcap/tidb#60085
|
2025-05-22 10:42:31 +00:00 |
|
|
|
ced609bfc7
|
ingestor: support TLS on nextgen (#61212)
ref pingcap/tidb#60418
|
2025-05-21 12:02:16 +00:00 |
|
|
|
1b8c67a71f
|
addindex: make sure real-tikv tests works on nextgen (#61207)
close pingcap/tidb#60418
|
2025-05-21 05:57:25 +00:00 |
|
|
|
cb040775d7
|
global-sort: unify error message for adding unique index using global sort (#61094)
ref pingcap/tidb#60621, close pingcap/tidb#61084
|
2025-05-16 05:44:40 +00:00 |
|
|
|
c71ebaf73e
|
global-sort: accelerate adding unique index using global sort (#60848)
ref pingcap/tidb#60621
|
2025-05-12 09:25:58 +00:00 |
|
|
|
2503d50c4d
|
global sort: add metrics for merge sort stage (#60971)
close pingcap/tidb#61025
|
2025-05-10 08:29:19 +00:00 |
|
|
|
c0176459da
|
globalsort: support onDup param for engine (#60950)
ref pingcap/tidb#60621
|
2025-05-08 05:14:16 +00:00 |
|
|
|
1a1897ec9c
|
lightning: gopls modernize (#60768)
close pingcap/tidb#60767
|
2025-05-08 03:57:43 +00:00 |
|
|
|
e774090927
|
localbackend: handle ingest pberror in next gen (#60895)
ref pingcap/tidb#60418
|
2025-04-30 03:34:20 +00:00 |
|
|
|
4ad4493246
|
ddl/dxf: modify param at runtime for add-index with global sort (part 1) (#60677)
ref pingcap/tidb#57229, ref pingcap/tidb#57497
|
2025-04-29 05:22:19 +00:00 |
|
|
|
033c23d9aa
|
globalsort: impl onDup for onefile writer (#60903)
ref pingcap/tidb#60621
|
2025-04-29 03:54:05 +00:00 |
|
|
|
0200e5d634
|
localbackend: merge feature branch next-gen (#60879)
ref pingcap/tidb#60418
|
2025-04-28 05:18:58 +00:00 |
|
|
|
8a3718f6fc
|
globalsort: support onDup param for writer (#60867)
ref pingcap/tidb#60621
|
2025-04-27 11:46:16 +00:00 |
|
|
|
593f552701
|
Lightning: Add RealOffset to checkpoint (#60723)
close pingcap/tidb#60734
|
2025-04-25 09:57:58 +00:00 |
|
|
|
5faa7496ef
|
ddl: fix OOM issue when adding many indexes (#60676)
ref pingcap/tidb#59508
|
2025-04-25 08:25:35 +00:00 |
|
|
|
d0e82fee1f
|
OWNERS: guard change for pkg/lightning/config (#60662)
ref pingcap/tidb#41241
|
2025-04-23 03:41:39 +00:00 |
|
|
|
531eb80580
|
*: add a RetryableErrorCount metric to trace error during DDL (#60485)
ref pingcap/tidb#60484
|
2025-04-22 14:23:02 +00:00 |
|
|
|
fc7b44a20d
|
localbackend: fix retry on ingest err 'disk full' (#60680)
close pingcap/tidb#60678
|
2025-04-21 10:30:19 +00:00 |
|
|
|
3a47685a38
|
globalsort: add definition for conflict handling and refactor (#60631)
ref pingcap/tidb#60621
|
2025-04-18 12:50:14 +00:00 |
|
|
|
f31911cc0d
|
globalsort: add util functions to remove duplicates and some refactor (#60622)
ref pingcap/tidb#60621
|
2025-04-17 13:14:55 +00:00 |
|
|
|
cc8d9cbbd4
|
lignthing/importinto: parallel reading files infos from data store (#59382)
close pingcap/tidb#56104, close pingcap/tidb#60224
|
2025-04-11 07:56:42 +00:00 |
|
|
|
d7b594d356
|
globalsort: replace key and value slice with kvPair (#60492)
ref pingcap/tidb#48779
|
2025-04-11 03:53:09 +00:00 |
|
|
|
558832594c
|
globalsort: fix wrong err is returned and fix log (#60431)
close pingcap/tidb#60410
|
2025-04-08 05:11:43 +00:00 |
|
|
|
61c09e601e
|
build(deps): bump github.com/golangci/golangci-lint from 1.63.4 to 1.64.7 (#60029)
|
2025-04-03 07:44:54 +00:00 |
|
|
|
e2d1d89c9e
|
*: inject random error for DXF (part1) (#60278)
ref pingcap/tidb#60277
|
2025-03-27 12:38:13 +00:00 |
|
|
|
f3d0e43040
|
*: upgrade to the latest client-go (#59757)
ref pingcap/tidb#58780
|
2025-03-27 07:32:36 +00:00 |
|
|
|
ed8b869a60
|
globalsort: write sorted kv meta to external storage (#59966)
close pingcap/tidb#60083
|
2025-03-26 09:39:54 +00:00 |
|
|
|
d51e00e5bb
|
globalsort: reduce number of SST ingested into TiKV (#59870) (#60045)
ref pingcap/tidb#51734, close pingcap/tidb#59962
|
2025-03-24 12:22:43 +00:00 |
|
