Commit Graph

56 Commits

Author SHA1 Message Date
dc30a5b7b3 *: LOAD DATA support load one file from s3 and other OSS (#40489)
ref pingcap/tidb#40499
2023-01-18 15:27:51 +08:00
89de573660 BR: add lock with ttl for checkpoint backup (#40563)
close pingcap/tidb#40561
2023-01-18 14:35:51 +08:00
0c1808245b *: support sample for compressed files for adjustment (#39680)
ref pingcap/tidb#38514
2022-12-19 15:42:54 +08:00
Bin
33e5baade9 fix: update ioutil.readall (#39850) 2022-12-13 10:24:51 +08:00
f18be893f3 br: add retry for azblob read file (#39650)
close pingcap/tidb#39649
2022-12-09 17:07:42 +08:00
032e6fd3f3 br: fix getting region failure with other s3 compatible storage (#39653)
close pingcap/tidb#39648
2022-12-07 11:18:07 +08:00
10b3bc7a11 lightning: refine progress for compress files import (#39219)
ref pingcap/tidb#38514
2022-12-02 10:34:00 +08:00
2914d8da09 backup: fix the object lock check with other s3 compatible storage (#39549)
close pingcap/tidb#39545
2022-12-02 06:20:00 +08:00
1de2bf6e54 Backup: add checkpoint (#38648)
close pingcap/tidb#38647
2022-11-30 12:52:00 +08:00
da7eddd685 lightning: make some s3/gcs external storage fields public (#39205)
close pingcap/tidb#39204
2022-11-17 13:17:55 +08:00
481f5abad9 lightning: support checkpoint read for compress files (#38946)
ref pingcap/tidb#38514
2022-11-11 16:03:52 +08:00
08aa32e888 *: update bazel config (#38745) 2022-11-01 12:15:59 +08:00
312155afbd lightning: Compress Reader/Writer supports reading/writing Snappy/Zstd type compressed files (#38603)
ref pingcap/tidb#38514
2022-10-31 10:55:59 +08:00
e0cfba60aa log-backup: directly override the exists file when do truncate on gcs or azure (#38232)
close pingcap/tidb#38229
2022-10-10 17:05:49 +08:00
a25917f156 cloud: support backup to s3 when object lock enabled. (#37392)
close tikv/tikv#13442
2022-09-15 12:14:59 +08:00
f78e05cd6d br: add retryer option for new storage (#37711)
close pingcap/tidb#37710
2022-09-09 00:18:55 +08:00
08b1faf2ad log-backup: restore the merge small backup files. (#36925)
close pingcap/tidb#36924
2022-09-08 12:20:57 +08:00
aab394fb42 br: handle special character in SQL (#37486)
close pingcap/tidb#37469
2022-09-06 15:04:56 +08:00
ef136efd12 br,lightning: S3 URL support assuming role (#36893)
close pingcap/tidb#36891
2022-08-04 23:06:06 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
xhe
9a16a8dd19 *: replace defer clean with t.Cleanup (#36722)
close pingcap/tidb#36721
2022-08-01 17:34:05 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
911e7cc360 *: enable revive (#35970)
ref pingcap/tidb#35345
2022-07-15 16:03:06 +08:00
f581ec3a45 test: remove meaningless test and update bazel (#36136) 2022-07-13 16:41:05 +08:00
1da144c329 br: modify to send s3 region param to tikv (#36056)
close pingcap/tidb#36055
2022-07-11 11:51:04 +08:00
7d37ac1dde br: get bucket region from s3 to enable users not to input s3 region param (#34419)
close pingcap/tidb#34275
2022-07-07 16:11:03 +08:00
114c922bc8 *: enable gosec (#35873)
ref pingcap/tidb#35345
2022-07-05 19:39:01 +08:00
e50b9430fc *: enable gci (#35823)
ref pingcap/tidb#35345
2022-07-04 14:53:02 +08:00
e00ad2b3ef *: enable errcheck for nogo (#35704)
ref pingcap/tidb#35345
2022-07-02 22:08:39 +08:00
44623f03f4 *: enable more flaky and update bazel config (#35500)
ref pingcap/tidb#35247
2022-06-20 21:46:37 +08:00
ed11cf2dce br,lightning: add in-memory implementation for external storage (#35271)
close pingcap/tidb#35270
2022-06-16 20:52:34 +08:00
2b4a4c6d7a *: support bazel (#33691)
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
964ae6c385 br/pkg/storage: add oss support on s3 sdk (#34309)
close pingcap/tidb#34224
2022-05-18 11:18:38 +08:00
9392793de5 lightning: trim prefix when use gcs/s3 Storage WalkDir (#34319)
close pingcap/tidb#34118
2022-05-16 11:14:37 +08:00
c6fe032e99 br: support PiTR feature (#34409)
ref pingcap/tidb#29501
2022-05-12 17:08:35 +08:00
6da6e5a571 *: fix build tag by run gofix (#34260)
ref pingcap/tidb#31716
2022-04-27 18:02:52 +08:00
7309b086ca lightning: support opening empty files and skip directory objects in S3 (#33029)
close pingcap/tidb#31824
2022-03-18 15:54:30 +08:00
c11e650527 *: make golangci-lint work on Go1.18 (#33081)
close pingcap/tidb#33080
2022-03-15 22:43:52 +08:00
11a1c18e8f lightning: checkpoint support s3 (#32373)
close pingcap/tidb#32374
2022-03-03 20:09:46 +08:00
c30e8320d8 *: correct use require (#31904)
ref pingcap/tidb#31716
2022-02-07 18:11:35 +08:00
ea7bc9766e dumpling: fix s3 compress writer (#30736)
close pingcap/tidb#30534
2022-01-24 15:26:11 +08:00
50520e3985 lint: fix lint errors in pkg br. (#31041)
close pingcap/tidb#31358
2022-01-06 10:54:36 +08:00
1dc16954d1 br: support azure blob storage (#30585)
close pingcap/tidb#30583
2021-12-31 14:57:51 +08:00
6d58e8ef37 br/pkg/storage: migrate test-infra to testify (#31026) 2021-12-28 17:25:49 +08:00
2b0400aa23 br: Enable lint gosec in br (#30895)
close pingcap/tidb#30699
2021-12-27 14:03:49 +08:00
b09c63be84 br: fix S3 backup endpoint suffix (#30530)
close pingcap/tidb#30104
2021-12-20 18:09:46 +08:00
778e188fa7 br: update permission, so tikv can write to folder when backup to local (#30396) 2021-12-18 00:46:36 +08:00
4b48e55ae9 lightning: Add source dir existence check for s3 (#30674) 2021-12-14 20:04:35 +08:00
bc08b50127 lightning: fix gcs max key limit (#30393) 2021-12-07 01:59:56 +08:00