|
|
9d860fc477
|
br: fix backup to aliyum OSS not support ak/sk as env (#54150)
close pingcap/tidb#45551
|
2024-07-02 04:23:56 +00:00 |
|
|
|
c60f97d16c
|
global sort: fix inner retry doesn't reset collector (#52965)
close pingcap/tidb#52884
|
2024-04-29 15:32:59 +00:00 |
|
|
|
f2ea18c07f
|
lightning: move lightning directory out of br (#52247)
ref pingcap/tidb#52182
|
2024-04-01 07:13:46 +00:00 |
|
|
|
732fee0c61
|
*: add OWNERS for storage pkg (#52199)
|
2024-03-28 09:21:49 +00:00 |
|
|
|
df79e5ca11
|
globalsort: opt merge step mem to run on 8c (#51924)
ref pingcap/tidb#50752
|
2024-03-22 10:36:50 +00:00 |
|
|
|
735adb03ea
|
external: make global sort common.Range unencoded (#51900)
close pingcap/tidb#51910
|
2024-03-20 13:24:44 +00:00 |
|
|
|
5d9a81c28c
|
s3: retry 3 times inside one Read (#51506)
close pingcap/tidb#51505
|
2024-03-06 03:42:34 +00:00 |
|
|
|
1fc92b32b0
|
storage: local storage tolerates broken symlink when Walk (#51170)
close pingcap/tidb#49423
|
2024-02-20 04:54:26 +00:00 |
|
|
|
44787d6b49
|
global sort: lower memLimit and other memory control change (#50640)
ref pingcap/tidb#49829, close pingcap/tidb#50753, close pingcap/tidb#50755
|
2024-01-30 08:10:53 +00:00 |
|
|
|
51e1e13494
|
*: update interface{} to any (#50770)
ref pingcap/tidb#50765
|
2024-01-29 07:21:29 +00:00 |
|
|
|
d6ef1c722a
|
br: add more retry strategy (s3.ReadFile: body reader / pushBackup: backoffer) (#50541)
close pingcap/tidb#49942
|
2024-01-24 10:52:51 +00:00 |
|
|
|
7ce7fb2a85
|
external: round robin to use multiple GCS clients (#50408)
close pingcap/tidb#50413
|
2024-01-23 09:43:49 +00:00 |
|
|
|
25afff4c93
|
global sort: raise maximum overlapping threshold (#50264)
close pingcap/tidb#50293
|
2024-01-22 06:18:20 +00:00 |
|
|
|
c92094fcb4
|
external: remove old compatibility check of BR (#50534)
close pingcap/tidb#50533
|
2024-01-18 04:30:16 +00:00 |
|
|
|
f4ba6d71ef
|
external: upgrade GCS SDK and retry for 401 error (#50447)
close pingcap/tidb#50448
|
2024-01-16 07:07:45 +00:00 |
|
|
|
82744b3323
|
test: use fgprof to show off-CPU profile in external package (#50179)
ref pingcap/tidb#48952
|
2024-01-11 07:34:55 +00:00 |
|
|
|
6c6c127eed
|
gcs: fix a deadlock in gs parallel writer (#49800)
ref pingcap/tidb#48443
|
2023-12-27 00:57:27 +00:00 |
|
|
|
7b8c876800
|
log_backup: add lock for truncating (#49469)
close pingcap/tidb#49414
|
2023-12-22 06:18:31 +00:00 |
|
|
|
b8fe33aa47
|
storage: support parallel write for gcs (#49545)
close pingcap/tidb#48443
|
2023-12-19 10:39:22 +00:00 |
|
|
|
47d460fa50
|
storage: try to detect credentials first in unit tests (#49478)
ref pingcap/tidb#48952
|
2023-12-15 04:28:51 +00:00 |
|
|
|
ced8af24c4
|
br: use atomic.Pointer instead of atomic.Value (#49359)
ref pingcap/tidb#44736
|
2023-12-13 08:12:20 +00:00 |
|
|
|
93225684c1
|
br/storage: add scope to support service_account type of credential file & remove default GCS httpclient (#49363)
ref pingcap/tidb#49340
|
2023-12-12 17:16:48 +00:00 |
|
|
|
8c8333a9ac
|
br/storage: disable keep alive for GCS on default to speed up request (#49341)
close pingcap/tidb#49340
|
2023-12-12 02:54:18 +00:00 |
|
|
|
720ae4b114
|
gloabl sort: add more test cases, and writer upload data in background (#48873)
ref pingcap/tidb#48779
|
2023-11-29 12:37:18 +00:00 |
|
|
|
c771e8b2f9
|
br/storage: enable async prefetch data (#48587)
close pingcap/tidb#48781
|
2023-11-24 04:44:42 +00:00 |
|
|
|
9cf638fb08
|
global sort: merge to one file (#48142)
ref pingcap/tidb#45719
|
2023-11-23 08:46:12 +00:00 |
|
|
|
49d1b66787
|
br: fix incorrect uri for the file storage (#48453)
close pingcap/tidb#48452
|
2023-11-20 07:50:41 +00:00 |
|
|
|
75e025362f
|
*: update ks3 SDK and add some workaround for ks3 SDK (#48277)
close pingcap/tidb#48278, close pingcap/tidb#48318
|
2023-11-09 04:35:12 +00:00 |
|
|
|
b99d1c4f7e
|
s3: fix s3 concurrent uploader will overwrite error (#48163)
close pingcap/tidb#48164
|
2023-11-01 12:33:37 +00:00 |
|
|
|
f4a139ffe3
|
br: avoid retry if it's ec2metadata (#47651)
close pingcap/tidb#47650
|
2023-10-19 09:00:29 +00:00 |
|
|
|
16f3e795b1
|
storage: support kingsoft s3 (ks3) (#47465)
close pingcap/tidb#47230
|
2023-10-15 05:04:57 +00:00 |
|
|
|
318e82bbb7
|
*: move most of the packages to 'pkg' (#47123)
ref pingcap/tidb#41241
|
2023-10-13 14:36:26 +00:00 |
|
|
|
fc4f8a1d8f
|
ddl: add more tests for multi-schema change (#47293)
ref pingcap/tidb#41602
|
2023-10-09 08:15:25 +00:00 |
|
|
|
fec9a5bd16
|
external: S3 concurrent reader releases memory after it's not used (#47239)
ref pingcap/tidb#45719
|
2023-10-07 07:15:23 +00:00 |
|
|
|
9d29580526
|
importinto: check access of cloud storage uri (#47206)
ref pingcap/tidb#46704
|
2023-09-22 15:00:14 +00:00 |
|
|
|
58a6f8f18f
|
external storage: extend some methods to (almost) all implementation (#47170)
ref pingcap/tidb#45719
|
2023-09-22 09:06:15 +00:00 |
|
|
|
e9b632e409
|
ddl: clean up cloud storage files after global sort (#47084)
ref pingcap/tidb#46258
|
2023-09-22 05:11:06 +00:00 |
|
|
|
59e31f064b
|
br: not use the custom http client for gcs (#47026)
close pingcap/tidb#47022
|
2023-09-18 07:45:10 +00:00 |
|
|
|
a7e3176f30
|
br: stop s3 retryer when connection is refused (#46938)
ref pingcap/tidb#46258
|
2023-09-13 09:57:11 +00:00 |
|
|
|
9cb19af5b1
|
variable: fix empty cloud storage uri (#46901)
ref pingcap/tidb#45719
|
2023-09-12 14:01:41 +00:00 |
|
|
|
eab042aa48
|
br: support reading a file concurrently from S3 (#46633)
ref pingcap/tidb#45719
|
2023-09-12 02:25:42 +00:00 |
|
|
|
cbb7b0abdd
|
global sort: support setting cloud storage uri variable (#46407)
ref pingcap/tidb#45719
|
2023-09-11 11:25:43 +00:00 |
|
|
|
e01d179044
|
lightning: add ExternalEngineConfig to create an external engine (#46636)
ref pingcap/tidb#45719
|
2023-09-07 13:35:16 +00:00 |
|
|
|
586b854a0b
|
importinto: estimate real file size by sample on compressed file (#46404)
ref pingcap/tidb#42930
|
2023-09-05 12:11:11 +00:00 |
|
|
|
a06bcc60e1
|
br/lightning: add DecompressConfig to external storage (#46430)
ref pingcap/tidb#42930
|
2023-08-29 06:18:38 +00:00 |
|
|
|
9b7c1e2226
|
*: upgrade gomock (#46394)
|
2023-08-25 02:47:06 +00:00 |
|
|
|
88225787f3
|
br: configure the httpclient for external storage (#46040)
close pingcap/tidb#46011
|
2023-08-16 05:51:30 +00:00 |
|
|
|
5309c2ff77
|
*: support concurrent write for S3 writer (#45723)
ref pingcap/tidb#45719
|
2023-08-04 10:58:10 +00:00 |
|
|
|
79971d53c9
|
br: support to write/ready azure blobs with customer provided key (#45026)
close pingcap/tidb#45025
|
2023-07-21 02:48:48 +00:00 |
|
|
|
8a8f514c94
|
br: hide_encryption_scope (#44683)
ref pingcap/tidb#44199
|
2023-06-16 13:23:10 +00:00 |
|
