Commit Graph

767 Commits

Author SHA1 Message Date
35e5b45212 br: support backup txn kv data (#40829)
* support txn backup and restore
2023-04-19 15:11:04 +08:00
d33b9ae173 load data: check table empty or not for physical mode (#43157)
ref pingcap/tidb#42930
2023-04-19 13:21:19 +08:00
f476d203bf br: fix unstable test (#43177)
close pingcap/tidb#43170
2023-04-19 11:59:19 +08:00
0c3b88c0ce lightning: fix generating region job is serialized (#43123)
close pingcap/tidb#42456
2023-04-19 11:43:19 +08:00
36c59c7562 restore: split between tables (#42972)
close pingcap/tidb#42924
2023-04-19 05:11:19 +08:00
0bfe3e72d3 Lightning: adjust precheck and refine error message (#42258)
close pingcap/tidb#42835, ref pingcap/tidb#42836
2023-04-19 01:07:19 +08:00
ab086ae3cf lightning: refactor checksum to reuse (#43082)
ref pingcap/tidb#42930
2023-04-18 21:05:19 +08:00
fa54151feb storage: replace standard gzip with klauspost/compress to increase effiency (#43129)
close pingcap/tidb#43128
2023-04-18 17:53:19 +08:00
9cf0ed8e8f br: pipeline backup schemas (#43003)
close pingcap/tidb#43002
2023-04-17 22:51:18 +08:00
2766aea88a br: checkpoint for full/log restore (#42340)
close pingcap/tidb#42339
2023-04-17 20:55:18 +08:00
c7f5868df0 load data: physical mode part 3 (#43020)
ref pingcap/tidb#42930
2023-04-17 15:35:19 +08:00
0c736ce28f lightning: always retry from needRescan when NotLeader (#43079)
close pingcap/tidb#43055
2023-04-17 11:09:18 +08:00
73c92b8ed2 pitr: support restoring duplicated log in PITR. (#42049)
close pingcap/tidb#42564
2023-04-14 21:52:46 +08:00
8b07b86670 br: auto config shard_count (#43012) 2023-04-14 10:55:01 +08:00
a55a1f1b37 sql: support SHOW BACKUP METADATA FROM <storage:str> (#42914)
close pingcap/tidb#42913
2023-04-13 22:21:01 +08:00
49748c4e92 lightning: remove glue (#42911) 2023-04-13 19:03:02 +08:00
bc14799e35 lightning: Fix build failure on FreeBSD (#43015)
close pingcap/tidb#43014
2023-04-13 17:33:10 +08:00
44aa4cf3cd lightning: generate and send region job more smoothly (#42780)
close pingcap/tidb#42456
2023-04-13 17:33:02 +08:00
6122ca307e linter: support lll to avoid too long line (#42718)
close pingcap/tidb#42570
2023-04-12 23:23:01 +08:00
7aac6abd86 ddl: support checkpoint for ingest mode (#42769)
close pingcap/tidb#42164
2023-04-12 20:59:02 +08:00
591849a8d3 restore: fix failed to restore due to no such policy (reversed cherry-pick) (#42800)
close pingcap/tidb#42796
2023-04-11 15:43:00 +08:00
d250a3fc16 lightning: refactor to reuse in load data part 5 (#42856)
ref pingcap/tidb#40499
2023-04-11 12:11:01 +08:00
2bf6eead13 *: LOAD DATA support compressed source file (#42813)
ref pingcap/tidb#40499
2023-04-10 16:33:00 +08:00
2af85d1fe9 load data: physical mode part1 (#42817)
ref pingcap/tidb#40499
2023-04-07 15:12:58 +08:00
b384b73f21 nogo: enable revive for br/pkg/lightning (#42752) 2023-04-05 21:40:58 +08:00
8f64f36864 lightning: refactor for reuse in load data part4 (#42727)
ref pingcap/tidb#40499
2023-04-04 17:56:57 +08:00
9cf69a9633 lightning: add lint rule & fix existing lightning lint err (#42733)
ref pingcap/tidb#40499
2023-04-03 13:36:56 +08:00
71fa84089e loaddata, lightning: support ascii, latin1, utf8 charset of source file (#42699)
ref pingcap/tidb#40499
2023-04-03 11:12:56 +08:00
4e30a64a66 lightning: refactor to reuse in load data, part 3 (#42689)
ref pingcap/tidb#40499
2023-03-31 14:48:55 +08:00
a0bb5444ab pitr: remove row count check for ingest recorder (#42708)
close pingcap/tidb#42707
2023-03-30 16:14:55 +08:00
0a08f64082 br: skip automatically get bucket region with other s3 compatible provider. (#41889)
close pingcap/tidb#41916, close pingcap/tidb#42033
2023-03-30 14:42:55 +08:00
6057f63d03 test: use concurrent-safe structure to fix a flaky test (#42680)
close pingcap/tidb#42301
2023-03-29 17:40:54 +08:00
af62a5cd0a disttask: add load data dispatcher (#42592)
close pingcap/tidb#42591
2023-03-29 14:48:54 +08:00
976148d868 lightning: refactor for reuse part2 (#42626)
ref pingcap/tidb#40499
2023-03-28 21:26:54 +08:00
22839a3af3 tools: add tazel (#42605)
close pingcap/tidb#42608
2023-03-28 11:20:54 +08:00
d636a81b81 lightning: refactor to reuse in load data, part1 (#42469)
ref pingcap/tidb#40499
2023-03-24 15:54:43 +08:00
d3de19e232 local: split job again when dynamic region (#42485)
close pingcap/tidb#42484
2023-03-24 10:34:43 +08:00
da89b1b42b lightning: register import task to pd (#42504)
ref pingcap/tidb#41536
2023-03-24 09:24:42 +08:00
9e3204bd29 lightning: always disable add-index-by-sql by default (#42514)
close pingcap/tidb#42457
2023-03-23 22:16:44 +08:00
78eec6ef31 bazel: update shard_count for test (#42491) 2023-03-23 12:08:42 +08:00
6897c1abb8 br: fix ci (#42480)
close pingcap/tidb#42460
2023-03-22 22:56:42 +08:00
3337cc11b1 Lightning: fix restore-bytes and encode speed metrics, add restore-rows metrics (#42070)
close pingcap/tidb#41751
2023-03-22 21:38:51 +08:00
d9149b0afa server: prefetch for DELETE and BatchPointGet when multi-statement (#29391)
close pingcap/tidb#41367
2023-03-22 20:14:42 +08:00
3c942f7e10 bazel: set short timeout as 120s (#42396) 2023-03-22 01:50:42 +08:00
03d19d2a2a lightning: add test about multi-rocksdb (#42243)
ref pingcap/tidb#42359
2023-03-21 15:44:41 +08:00
8ba2035203 br: make restore resource group compatible with old tidb (#42388)
ref pingcap/tidb#42266
2023-03-21 11:30:41 +08:00
fc166ffae8 *: enable more race and set timeout for test (#42371) 2023-03-20 12:44:40 +08:00
31aff1137e Lightning: don't use pd port in tidb backend (#42355)
close pingcap/tidb#42354
2023-03-17 21:03:05 +08:00
e7794ba39d br/restore: fail fast when meeting some error during restoration (#42158)
close pingcap/tidb#42157
2023-03-17 18:35:00 +08:00
07178874b6 lightning: use sql to add secondary indexes (#42136)
close pingcap/tidb#42132
2023-03-17 18:34:53 +08:00