Commit Graph

801 Commits

Author SHA1 Message Date
56dacd0265 lightning: fix oom when mem/cpu ratio is low (#43729)
close pingcap/tidb#43728
2023-05-12 03:36:21 +00:00
zzm
2ba3400a34 lightning: fix missing configurable keyspace name (#43685)
close pingcap/tidb#43684
2023-05-12 02:58:21 +00:00
5909400b96 br: use AWS CreateSnapshots API to automic create snapshots for multiple volumes (#43591)
close pingcap/tidb#43433
2023-05-11 09:25:21 +00:00
3b025117a9 lightning: update lightning metrics to bargauge (#43640)
ref pingcap/tidb#43357
2023-05-11 08:35:29 +00:00
ce1b6f986e br/cmd: implement the operator pause-gc-and-schedulers command (#43562)
ref pingcap/tidb#43559
2023-05-10 09:00:08 +00:00
03ea3c12b8 br: push down checkpoint record (#43633)
close pingcap/tidb#43632
2023-05-09 11:20:58 +00:00
0950948125 *: enable mirror linter (#43644)
ref pingcap/tidb#40786
2023-05-09 10:23:05 +00:00
14fcd8df0c lightning: support resuming from checkpoint when TiDB IP is changed (#43575)
close pingcap/tidb#43574
2023-05-09 09:18:58 +00:00
fd438de6a8 br: Fix RangeTree.GetIncompleteRange when the rangeTree is empty. (#37086)
ref pingcap/tidb#37085
2023-05-08 10:22:58 +00:00
08541498f7 br: avoid too many warning logs after update schema version (#43416)
close pingcap/tidb#43402
2023-05-08 09:45:06 +00:00
2d259bdcb6 br: add more retryable error for retryer (#43022)
close pingcap/tidb#42909
2023-05-08 09:44:58 +00:00
61e92b1d2d fix(dos2unix): use unix eol(LF) rather than dos(CRLF) (#43603)
close pingcap/tidb#43602
2023-05-08 07:26:57 +00:00
a9d8f90180 br: revert wrong commits (#43589)
close pingcap/tidb#43588
2023-05-08 03:50:57 +00:00
0de2220b80 build(deps): bump github.com/go-sql-driver/mysql from 1.7.0 to 1.7.1 in /parser (#43507) 2023-05-07 11:46:56 +00:00
b51758efdb br: enhancement for checkpoint (#43384)
close pingcap/tidb#43270
2023-05-06 10:44:56 +00:00
6e32106b93 br/lighting: add multi-valued index test (#41977)
close pingcap/tidb#42037
2023-05-06 10:06:56 +00:00
6488c35a25 sql: implement SHOW BR JOBS <n:int> and CANCEL BR JOB <n:int> (#43074)
close pingcap/tidb#43072
2023-05-05 10:45:57 +00:00
8728abc40e restore: Revert "split between tables" (#43435)
ref tikv/tikv#14641, ref pingcap/tidb#42924
2023-05-05 03:31:57 +00:00
a9045825ae br: make logs more clear. (#43519) 2023-05-04 13:09:55 +00:00
b901431398 *: use time.DateTime,time.DateOnly to replace magic number (#43505) 2023-05-04 03:21:55 +00:00
0b1144488f lightning: fix pd retry and add ut for it (#43432)
close pingcap/tidb#43400
2023-04-27 11:05:52 +00:00
252bc7383a lightning: fix some grafana panel json (#43356)
close pingcap/tidb#43357
2023-04-27 08:27:52 +00:00
e2277cf7dd load data: time and log for different phase, use err group in chunk_process (#43245)
ref pingcap/tidb#42930
2023-04-26 07:29:52 +00:00
f224d95093 lightning: reuse worker-concurr and remove range-concurr in local backend (#43348)
ref pingcap/tidb#42930
2023-04-25 07:13:52 +00:00
883c7b446d lightning: fix wrongly retry writing when partial write + "needRescan" (#43364)
Signed-off-by: lance6716 <lance6716@gmail.com>
2023-04-24 09:38:47 +00:00
eca3e7af44 br: directly use the rewrite rule from schemaReplaces (#43190)
* draft

Signed-off-by: Leavrth <jianjun.liao@outlook.com>

* draft

Signed-off-by: Leavrth <jianjun.liao@outlook.com>

* make bazel_prepare

Signed-off-by: Leavrth <jianjun.liao@outlook.com>

---------

Signed-off-by: Leavrth <jianjun.liao@outlook.com>
2023-04-24 04:32:45 +00:00
1a94e5db78 backup: fix retry of fine-grained backup (#43252)
close pingcap/tidb#43236
2023-04-22 00:23:20 +08:00
2095bb84bc *: fix plugin build (#43299)
close pingcap/tidb#43298
2023-04-21 23:35:20 +08:00
69d9a7c735 lightning: retry on unknown RPC error, log more info to help debug (#43293)
close pingcap/tidb#43291
2023-04-21 21:33:20 +08:00
d547306335 lightning: fix MakeTableRegions may panic when context is canceled (#43196)
close pingcap/tidb#43195
2023-04-20 13:39:18 +08:00
3cf494f03d br: support snapshot + log restore and support different tasks for checkpoint (#43134)
ref pingcap/tidb#43133
2023-04-20 09:17:19 +08:00
75570e929a lighting: change log level to debug for "keys within region is empty, skip doIngest" (#43198)
close pingcap/tidb#43197
2023-04-20 01:29:28 +08:00
f22ae5f8a3 backup: check the store state by last heartbeat (#43099)
close pingcap/tidb#42973
2023-04-19 23:13:20 +08:00
2aa72b7db6 load data: physical mode part 4 (#43162)
ref pingcap/tidb#42930
2023-04-19 19:01:20 +08:00
35e5b45212 br: support backup txn kv data (#40829)
* support txn backup and restore
2023-04-19 15:11:04 +08:00
d33b9ae173 load data: check table empty or not for physical mode (#43157)
ref pingcap/tidb#42930
2023-04-19 13:21:19 +08:00
f476d203bf br: fix unstable test (#43177)
close pingcap/tidb#43170
2023-04-19 11:59:19 +08:00
0c3b88c0ce lightning: fix generating region job is serialized (#43123)
close pingcap/tidb#42456
2023-04-19 11:43:19 +08:00
36c59c7562 restore: split between tables (#42972)
close pingcap/tidb#42924
2023-04-19 05:11:19 +08:00
0bfe3e72d3 Lightning: adjust precheck and refine error message (#42258)
close pingcap/tidb#42835, ref pingcap/tidb#42836
2023-04-19 01:07:19 +08:00
ab086ae3cf lightning: refactor checksum to reuse (#43082)
ref pingcap/tidb#42930
2023-04-18 21:05:19 +08:00
fa54151feb storage: replace standard gzip with klauspost/compress to increase effiency (#43129)
close pingcap/tidb#43128
2023-04-18 17:53:19 +08:00
9cf0ed8e8f br: pipeline backup schemas (#43003)
close pingcap/tidb#43002
2023-04-17 22:51:18 +08:00
2766aea88a br: checkpoint for full/log restore (#42340)
close pingcap/tidb#42339
2023-04-17 20:55:18 +08:00
c7f5868df0 load data: physical mode part 3 (#43020)
ref pingcap/tidb#42930
2023-04-17 15:35:19 +08:00
0c736ce28f lightning: always retry from needRescan when NotLeader (#43079)
close pingcap/tidb#43055
2023-04-17 11:09:18 +08:00
73c92b8ed2 pitr: support restoring duplicated log in PITR. (#42049)
close pingcap/tidb#42564
2023-04-14 21:52:46 +08:00
8b07b86670 br: auto config shard_count (#43012) 2023-04-14 10:55:01 +08:00
a55a1f1b37 sql: support SHOW BACKUP METADATA FROM <storage:str> (#42914)
close pingcap/tidb#42913
2023-04-13 22:21:01 +08:00
49748c4e92 lightning: remove glue (#42911) 2023-04-13 19:03:02 +08:00