Commit Graph

1220 Commits

Author SHA1 Message Date
ad63eb8d1e disttask: add StepExecFrameworkInfo as an example of Impl access Base (#52192)
ref pingcap/tidb#47006
2024-03-29 04:20:19 +00:00
732fee0c61 *: add OWNERS for storage pkg (#52199) 2024-03-28 09:21:49 +00:00
5f53c70a80 br: remove misleading log info (#52145)
close pingcap/tidb#50837
2024-03-28 09:02:19 +00:00
e925628b73 lightning: fix an incorrect metric (#52111)
close pingcap/tidb#51947
2024-03-27 08:24:48 +00:00
b96f08134d infoschema: fix panic for TableByID when table id is negative (#52016)
close pingcap/tidb#52012
2024-03-27 05:06:47 +00:00
1549ea645c br: change default value to coarse-grained (#52120)
close pingcap/tidb#52114
2024-03-26 14:45:47 +00:00
8428e387e7 br: turn on coarse-grained as default for restore (#51830)
ref pingcap/tidb#50701
2024-03-26 11:11:17 +00:00
bd17acde8c infoschema: introduce MetaOnlyInfoSchema to provide meta only information schema (#52070)
close pingcap/tidb#52072
2024-03-26 10:20:17 +00:00
b6dd17974b restore: use a limited workpool (#51872)
ref pingcap/tidb#50701, close pingcap/tidb#51621
2024-03-26 09:42:47 +00:00
02b277a667 operator: make gRPC connections synced (#52051)
close pingcap/tidb#52049
2024-03-25 13:02:17 +00:00
40456f36fe *: make package sqlexec not depend on sessionctx anymore (#52031)
close pingcap/tidb#52029
2024-03-25 11:59:17 +00:00
411e945da3 operator: pause scheduler after all connections established (#51823)
ref pingcap/tidb#51448
2024-03-25 09:03:47 +00:00
90b21d95b8 br,lightning: move GetSplitKeyPerRegion into shared package (#52052)
ref pingcap/tidb#51533
2024-03-25 07:54:46 +00:00
8492f75086 br: Change default check point lag limit (#51906)
ref pingcap/tidb#50803
2024-03-25 06:33:47 +00:00
490e17c9ab importinto: add log for chunk checksum & replace codec with keyspace (#52054)
ref pingcap/tidb#49008
2024-03-25 05:45:46 +00:00
c3fa89acd3 br: use atomic for failedFilesCount (#52046) 2024-03-25 04:51:46 +00:00
8b8b3f73da lightning: allow parallel import with conflict detection (#52002)
close pingcap/tidb#52001
2024-03-22 10:36:57 +00:00
df79e5ca11 globalsort: opt merge step mem to run on 8c (#51924)
ref pingcap/tidb#50752
2024-03-22 10:36:50 +00:00
b91a1b3c41 lightning: change MinRowID because ADD UNIQUE INDEX may be smaller (#51955)
close pingcap/tidb#51954
2024-03-21 11:08:14 +00:00
f6ce672e9c lightning: fix an incorrect metric (#51948)
close pingcap/tidb#51947
2024-03-21 09:11:14 +00:00
956d22edeb br/lightning: unify SplitWaitScatter logic into split package (#51864)
close pingcap/tidb#51520, ref pingcap/tidb#51533
2024-03-21 05:48:43 +00:00
735adb03ea external: make global sort common.Range unencoded (#51900)
close pingcap/tidb#51910
2024-03-20 13:24:44 +00:00
274d5e2e64 log_backup: remove checking store number (#51886)
close pingcap/tidb#51957
2024-03-20 12:11:13 +00:00
62fa6d18a7 test: fix the stuck issue when use raw kv restore (#51885)
ref pingcap/tidb#50701
2024-03-19 11:36:42 +00:00
61c471487e globalsort: split files evenly in MergeOverlappingFiles (#51878)
ref pingcap/tidb#50752
2024-03-19 08:41:13 +00:00
eea121309a lightning: skip CREATE DATABASE when downstream exists, and return error when parse failed (#51801)
close pingcap/tidb#51800
2024-03-18 10:06:50 +00:00
83f59ed61a br/utils: add WithRetryReturnLastErr and backoffer (#51764)
ref pingcap/tidb#51533
2024-03-18 03:59:12 +00:00
25fd7c9f02 br: move WaitRegionsSplit into split package (#51779)
ref pingcap/tidb#51533
2024-03-18 03:24:42 +00:00
b3cb95db05 txn: save RPCs for Pipelined-DML (#51652)
close pingcap/tidb#51625
2024-03-16 11:59:11 +00:00
222fe17e25 global sort: remove some unused code (#51811)
ref pingcap/tidb#50752
2024-03-15 12:48:40 +00:00
cbd41115f3 br: skip loading stats into memory if set --load-stats to false (#51535)
ref pingcap/tidb#50568
2024-03-15 10:48:41 +00:00
4d4f438ca5 restore: backpressure the importer producer goroutine (#51777)
ref pingcap/tidb#50701
2024-03-15 06:27:42 +00:00
3ab313d75c external: parallel seekPropsOffsets (#51676)
close pingcap/tidb#51639
2024-03-15 05:09:41 +00:00
857e5f9438 br: pre allocate table id at first (#51737)
close pingcap/tidb#51736
2024-03-15 04:35:11 +00:00
5b8185f136 lightning: merge configuration for preprocess duplicate detection and post-import conflict detection (#51710)
ref pingcap/tidb#51036
2024-03-15 03:38:11 +00:00
2a0050cd20 br: fix typo in client.go (#51239) 2024-03-14 09:08:11 +00:00
fa9f84e51a lighting: increase pd client retry count on error during initialization (#51706) 2024-03-13 18:05:10 +00:00
893104ad2c *: support reading historial data for infoschema v2 (#51681)
ref pingcap/tidb#50959, close pingcap/tidb#51679
2024-03-13 11:32:10 +00:00
ccc453bfe9 lightning: improve post-import conflict detection 'error' semantic (#51277)
ref pingcap/tidb#51036
2024-03-13 10:48:40 +00:00
ris
7548df70b1 br: Enable checkpoint advancer to pause tasks lagged too large (#51441)
close pingcap/tidb#50803
2024-03-13 09:03:39 +00:00
8f9fbbba58 txn: fix Pipelined DML duplicate entry message (#51708)
ref pingcap/tidb#50215
2024-03-13 07:59:15 +00:00
cd60e7fadb br, lightning: unify the calling of WaitForScatterRegion (#51651)
ref pingcap/tidb#51533
2024-03-13 06:57:39 +00:00
7a62f45812 prepare_snap: establish connection to all stores before pausing admin (#51449)
close pingcap/tidb#51448
2024-03-13 05:51:39 +00:00
e3d74d37c9 bootstrage: reserve bootstrap versions for v7.5.x (#51692)
close pingcap/tidb#51690
2024-03-13 04:41:15 +00:00
0639290a96 restore: shift rewrite ranges before split ranges (#51653)
close pingcap/tidb#51685
2024-03-12 11:39:39 +00:00
xhe
15947c1cf2 logutil: adapt new redact functions (#51642)
close pingcap/tidb#51310, close pingcap/tidb#51641
2024-03-12 09:06:39 +00:00
d604b06939 br: stop log when full restore failed (#51578)
close pingcap/tidb#51572
2024-03-12 03:17:09 +00:00
c6a4aec01f util: use atomic.Pointer to replace with atomic.Value (#51633)
ref pingcap/tidb#44736
2024-03-11 06:18:37 +00:00
5cb6c0e2af br: move ScatterRegions into split package (#51614)
ref pingcap/tidb#51533
2024-03-11 05:47:08 +00:00
cbe52e6438 txn: introduce pipelined DML (#50389)
ref pingcap/tidb#50215
2024-03-08 10:12:37 +00:00