Commit Graph

43 Commits

Author SHA1 Message Date
26378cbe48 lightning: make table in BaseKVEncoder private and provide some wrapped methods (#54673)
ref pingcap/tidb#54397
2024-07-18 03:40:31 +00:00
f158c65446 table: provide some binlog related methods for binlog in MutateContext (#54433)
ref pingcap/tidb#54392, ref pingcap/tidb#54397
2024-07-10 05:43:33 +00:00
53dcc79a6d lightning: improve log (#54483)
close pingcap/tidb#46687, close pingcap/tidb#54478
2024-07-10 03:16:33 +00:00
eec1d4fbdf lightning: reduce the "unable to get keyspace name" log level to DEBUG (#54243)
close pingcap/tidb#54232
2024-07-04 04:38:58 +00:00
1480bb127a lighting: lightning configuration tidb.tls = false should not affect cluster certificate (PD's connection) (#54211)
close pingcap/tidb#54172
2024-07-02 08:31:27 +00:00
bcd797e9e6 tables: optimize memory allocation in tables' hot path (#53832)
close pingcap/tidb#53837
2024-06-22 06:32:49 +00:00
a8de5891fe lightning: improve TotalMemoryConsume for write step (#53856)
ref pingcap/tidb#53858
2024-06-19 01:55:17 +00:00
329a9800c4 ddl: fast-reorg set memory limit for local writer based on current usage (#53873)
ref pingcap/tidb#53789
2024-06-13 12:09:27 +00:00
5c0d73719b build(deps): bump github.com/golangci/golangci-lint from 1.58.1 to 1.59.0 (#53869) 2024-06-08 12:28:28 +00:00
98a0a755fb ddl: unify merging unique and non-unique index for multi-schema change (#53632)
close pingcap/tidb#53677
2024-06-05 09:07:26 +00:00
827720395d go.mod: update the clients to adopt the latest fix/optimization (#53788)
ref pingcap/tidb#35319
2024-06-04 07:20:57 +00:00
c6e6c1545b lightning: turn off zstd decoding concurrency (#53589)
ref pingcap/tidb#53587
2024-06-03 09:38:54 +00:00
29bf0083a6 localbackend: fix resource leak when err on new local backend (#53664)
close pingcap/tidb#53659
2024-05-30 04:14:51 +00:00
afd8de1f62 lightning: release the requirement for NewTargetInfoGetterImpl (#53651) 2024-05-30 02:59:51 +00:00
9164182d0b config: must set line terminator when use strict-format (#53444)
close pingcap/tidb#37338
2024-05-27 08:41:50 +00:00
zzm
22dc064694 lightning: update parquet-go to optimize the memory usage when importing parquet files. (#53474)
close pingcap/tidb#53466
2024-05-23 05:25:17 +00:00
67531d0d92 lightning: provide view for users when using conflict detection (#53289)
close pingcap/tidb#52393
2024-05-21 09:43:17 +00:00
1c4a9c6434 br: separate the restore client (#53197)
ref pingcap/tidb#52877
2024-05-17 05:07:13 +00:00
dd177a808a lightning: update util.go (#53204) 2024-05-13 00:58:10 +00:00
98312088b8 lightning/config: align the behaviour of tidb.tls to doc (#53140)
close pingcap/tidb#53001
2024-05-10 14:31:09 +00:00
f46db203f9 *: caller can use a fixed TS for fast reorg (#52993)
close pingcap/tidb#46986, ref pingcap/tidb#49233
2024-05-10 13:31:09 +00:00
c60f97d16c global sort: fix inner retry doesn't reset collector (#52965)
close pingcap/tidb#52884
2024-04-29 15:32:59 +00:00
0f0418fb4a expression: change ExprCtxExtendedImpl to SessionExprContext (#52839)
close pingcap/tidb#52838
2024-04-29 12:43:28 +00:00
ff4784e5dc lightning: performance optimization for post-import conflict detection (#52656)
close pingcap/tidb#52306
2024-04-29 12:02:58 +00:00
54ba0ed684 lightning: fix delete additionally inserted rows for conflict detection 'replace' mode failed (#52888)
close pingcap/tidb#52886
2024-04-25 14:21:12 +00:00
773ce7e07e lightning: refactor schema importer (#52334)
ref pingcap/tidb#52142
2024-04-24 05:52:41 +00:00
0805e850d4 br: handle region leader miss (#52822)
close pingcap/tidb#50501, close pingcap/tidb#51124
2024-04-24 05:06:10 +00:00
3368ccdef1 expression: introduce StaticEvalContext to provide context when evaluating expressions (#52631)
close pingcap/tidb#52630
2024-04-23 06:52:40 +00:00
72e5460ee8 lightning/importinto: fix insert err after import for AUTO_ID_CACHE=1 and SHARD_ROW_ID_BITS (#52712)
close pingcap/tidb#52654
2024-04-18 08:10:38 +00:00
113b633689 lightning: merge conflict record tables for preprocess duplicate detection and post-import conflict detection (#52307)
ref pingcap/tidb#52306
2024-04-15 04:30:05 +00:00
5814957ace ddl: fix runnable ingest job checking (#52503)
close pingcap/tidb#52475
2024-04-12 04:33:23 +00:00
0362dc81fe lightning: return 0 early on empty parquet files (#52519)
close pingcap/tidb#52518
2024-04-12 02:10:53 +00:00
2b6b78af22 lightning: update dependency pebbledb to v1.1.0 (#52400)
close pingcap/tidb#52402
2024-04-10 10:24:22 +00:00
25da0bc25a br: use common scan-split-scatter logic (#52433)
ref pingcap/tidb#51533
2024-04-10 04:12:21 +00:00
a0b58619f1 lightning: move scan-split-scatter regions logic into common package (#52399)
ref pingcap/tidb#51533
2024-04-09 03:16:51 +00:00
1905e8973c expression: add some methods in BuildContext to read fields in SessionVars before (#52367)
close pingcap/tidb#52366
2024-04-09 02:39:20 +00:00
bdffd30129 br, lightning: move *batch* split region logic into common package (#52300)
ref pingcap/tidb#51533
2024-04-07 02:57:19 +00:00
555ce02352 lightning: Don't log "received task config" in server mode (#52336)
close pingcap/tidb#36374
2024-04-03 14:09:18 +00:00
482ce59bf6 expression: separate BuildContext and EvalContext (#52311)
close pingcap/tidb#52310
2024-04-03 09:42:24 +00:00
9ad086268e lightning: fix incorrect handling of duplicated key error message (#52316)
close pingcap/tidb#52312
2024-04-03 03:12:17 +00:00
3cfea6a32a br,lightning: refine GetSplitKeysOfRegions (#52235)
ref pingcap/tidb#51533
2024-04-01 12:51:17 +00:00
7c6241fee6 lightning: remove error check in TestAdjustBlockSize (#52278)
close pingcap/tidb#52277
2024-04-01 11:36:17 +00:00
f2ea18c07f lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
2024-04-01 07:13:46 +00:00