3176b9c263
*: move XXInfo/Job, etc, out from model pkg in parser to meta ( #55754 )
...
ref pingcap/tidb#54436
2024-09-04 04:49:45 +00:00
197476a41d
br: cli refactor backup error handling logic ( #54697 )
...
close pingcap/tidb#54696
2024-07-26 16:46:15 +00:00
1acb8f7e43
br: make br compatible with infoschemaV2 ( #52718 )
...
close pingcap/tidb#52717
2024-07-25 06:31:35 +00:00
99abc284f5
Backup: split batch store backup requests ( #54151 )
...
ref pingcap/tidb#52534
2024-06-25 04:58:20 +00:00
eac80126da
backup: use history iterator to scan ddl jobs ( #54100 )
...
close pingcap/tidb#54139
2024-06-24 12:08:50 +00:00
3e180e298d
backup: fix the missing first store state during backup ( #53920 )
...
ref pingcap/tidb#52534
2024-06-17 05:41:46 +00:00
dcadcde406
backup: watch store state and retry backup immediately ( #53341 )
...
close pingcap/tidb#52534
2024-06-06 03:50:55 +00:00
835ea0451a
backup: implement store based backup to solve the long tail issue ( #53081 )
...
ref pingcap/tidb#52534
2024-05-16 11:13:13 +00:00
81da4f8811
br: send backup request in batch ( #52535 )
...
ref pingcap/tidb#52534
2024-05-07 07:31:07 +00:00
f7a80042a1
br: rebase auto random id if the table is common handle ( #52256 )
...
close pingcap/tidb#52255
2024-04-01 12:16:46 +00:00
422ae46b6e
lightning/br: move some common code into outer pkg ( #52191 )
...
ref pingcap/tidb#52182
2024-03-29 07:03:55 +00:00
5f53c70a80
br: remove misleading log info ( #52145 )
...
close pingcap/tidb#50837
2024-03-28 09:02:19 +00:00
d6ef1c722a
br: add more retry strategy (s3.ReadFile: body reader / pushBackup: backoffer) ( #50541 )
...
close pingcap/tidb#49942
2024-01-24 10:52:51 +00:00
7e5a5b2912
backup: more stable check liveness when store heartbeat behind too much ( #48403 )
...
close pingcap/tidb#48405
2023-12-14 15:34:50 +00:00
6c30c6e6aa
br: refactor error handle mechanism to tolerant unexpect kv errors. ( #48646 )
...
close pingcap/tidb#47656
2023-12-08 05:20:52 +00:00
318e82bbb7
*: move most of the packages to 'pkg' ( #47123 )
...
ref pingcap/tidb#41241
2023-10-13 14:36:26 +00:00
e82519e79d
restore: rewrite auto increment id after pitr ( #46521 )
...
close pingcap/tidb#46520
2023-09-04 11:06:44 +00:00
2abf83ddd5
*: remove feedback ( #45969 )
...
ref pingcap/tidb#46056
2023-08-21 11:03:34 +00:00
0dad9f27fc
*: fix the duplicate entry error when using BR to restore a NONCLUSTERED AUTO_ID_CACHE=1 table ( #46127 )
...
close pingcap/tidb#46093
2023-08-18 03:47:01 +00:00
e0f62ef19e
*: fix 'duplicate entry' error when using br to restore AUTO_ID_CACHE=1 tables ( #44743 )
...
ref pingcap/tidb#38442 , close pingcap/tidb#44716
2023-06-20 03:32:41 +00:00
ffea45b718
ddl: enable linter revive ( #44380 )
...
ref pingcap/tidb#40786
2023-06-03 05:11:39 +00:00
a085eff3da
br: a new checkpoint file format with smaller space used ( #43812 )
...
close pingcap/tidb#43811
2023-05-18 11:21:36 +00:00
b51758efdb
br: enhancement for checkpoint ( #43384 )
...
close pingcap/tidb#43270
2023-05-06 10:44:56 +00:00
1a94e5db78
backup: fix retry of fine-grained backup ( #43252 )
...
close pingcap/tidb#43236
2023-04-22 00:23:20 +08:00
2095bb84bc
*: fix plugin build ( #43299 )
...
close pingcap/tidb#43298
2023-04-21 23:35:20 +08:00
35e5b45212
br: support backup txn kv data ( #40829 )
...
* support txn backup and restore
2023-04-19 15:11:04 +08:00
9cf0ed8e8f
br: pipeline backup schemas ( #43003 )
...
close pingcap/tidb#43002
2023-04-17 22:51:18 +08:00
2766aea88a
br: checkpoint for full/log restore ( #42340 )
...
close pingcap/tidb#42339
2023-04-17 20:55:18 +08:00
01f8f6a84a
br: fix backup ci ( #41295 )
...
ref pingcap/tidb#40404 , ref pingcap/tidb#40898
2023-02-11 22:22:00 +08:00
7f88e73af6
br: skip template system table __TiDB_BR_Temporary_mysql when backup ( #41000 )
...
close pingcap/tidb#40797
2023-02-09 23:53:59 +08:00
9cb4c488fc
br: Support backup replica read ( #40899 )
...
ref pingcap/tidb#40898
2023-02-09 18:06:08 +08:00
91f675247d
flashback: make br backup full works during flashback cluster ( #40950 )
...
close pingcap/tidb#40404
2023-02-08 16:15:59 +08:00
76153ab9ff
lint: update config of deprecated linter ( #40763 )
...
ref pingcap/tidb#40786
2023-01-28 11:57:53 +08:00
89de573660
BR: add lock with ttl for checkpoint backup ( #40563 )
...
close pingcap/tidb#40561
2023-01-18 14:35:51 +08:00
1de2bf6e54
Backup: add checkpoint ( #38648 )
...
close pingcap/tidb#38647
2022-11-30 12:52:00 +08:00
f9a6e47192
planner: support push part of order property down to the partition table ( #36108 )
...
ref pingcap/tidb#26166
2022-11-29 13:51:59 +08:00
6477e7521f
br: remove error when create the backup client to make caller easier ( #39303 )
...
close pingcap/tidb#39302
2022-11-22 12:27:57 +08:00
c4316fbc74
log-backup: support restart task after stop a log-backup task ( #38381 )
...
close pingcap/tidb#38382
2022-10-27 13:19:57 +08:00
181fb8e905
br: merge feature branch of ebs-based-br ( #37297 )
...
ref pingcap/tidb#35306
2022-09-18 20:37:00 +08:00
7ca368650c
br: add a test for cached table ( #31191 )
...
close pingcap/tidb#31190
2022-08-12 18:08:51 +08:00
158ba1a1d9
*: enable part revive for all code ( #36703 )
2022-08-01 14:02:06 +08:00
56dadec862
ddl: Preparation for add index acceleration ( #36085 )
...
ref pingcap/tidb#35983
2022-07-28 16:43:11 +08:00
f22098cc5d
br: don't encode key of raw kv. ( #36491 )
...
ref pingcap/tidb#36490
2022-07-27 19:05:11 +08:00
6ae88c4309
br: use one shot session to close domain ASAP ( #36558 )
...
* br: use one shot session to close domain ASAP
Co-authored-by: Ian <ArGregoryIan@gmail.com >
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io >
2022-07-26 20:15:53 +08:00
ab513bf0ca
ddl: support concurrent ddl ( #32169 )
...
* 1. init ddl tables
create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table
* 2. setup concurrent ddl env and add ddl worker pool
adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute
* 3. add ddl manager to handle ddl job
* 4. reorg handler for concurrent ddl
just implements the partner of the reorg information.
* 5. manage ddl jobs for concurrent ddl
add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller
* 6. add metrics for concurrent ddl
add metrics
* 7. support multiple tables
* 8. fix test
* 9. migrate ddl between table and queue
support switch between the old and new ddl framework, migrate the existing ddl job between queue and table
* 10. check tikv version and set reorg worker count according cpu count
* *: add featuretag on tests
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com >
* use a determined table id for 3 tables
* remove ctx value
* add GetSchemaVersionWithNonEmptyDiff function
* address tangenta and zimulala comment
* use only one etcd path
* make ActionRenameTable support multi-schema
* reset sql digest to make top sql work correct
* add comment
* fix test
* remove 0 for schema version lock
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com >
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io >
Co-authored-by: wjHuang <huangwenjun1997@gmail.com >
2022-07-20 21:20:07 +08:00
eb3de65c6e
Br: refactor log messages ( #35760 )
...
close pingcap/tidb#35928
2022-07-08 15:17:03 +08:00
3c83cd3106
BR: fix backup ranges total time summary log ( #35552 )
...
close pingcap/tidb#35553
2022-06-23 23:12:37 +08:00
26df62fef2
test: improve some tests ( #35092 )
...
ref pingcap/tidb#32031
2022-06-01 18:50:28 +08:00
7f023bd61b
ddl: wrap some functions for ddl job ( #34920 )
...
close pingcap/tidb#34919
2022-05-29 15:38:26 +08:00
c6fe032e99
br: support PiTR feature ( #34409 )
...
ref pingcap/tidb#29501
2022-05-12 17:08:35 +08:00
