6ae88c4309
br: use one shot session to close domain ASAP ( #36558 )
...
* br: use one shot session to close domain ASAP
Co-authored-by: Ian <ArGregoryIan@gmail.com >
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io >
2022-07-26 20:15:53 +08:00
bf743a6ca0
*: enable flaky test for all test ( #36385 )
...
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
6c704f756f
log-backup: remove the timezone from log-date ( #36369 )
...
close pingcap/tidb#36370
2022-07-21 20:01:09 +08:00
656b5a5e80
br: fix broken integration test ( #36411 )
2022-07-21 16:49:09 +08:00
ab513bf0ca
ddl: support concurrent ddl ( #32169 )
...
* 1. init ddl tables
create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table
* 2. setup concurrent ddl env and add ddl worker pool
adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute
* 3. add ddl manager to handle ddl job
* 4. reorg handler for concurrent ddl
just implements the partner of the reorg information.
* 5. manage ddl jobs for concurrent ddl
add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller
* 6. add metrics for concurrent ddl
add metrics
* 7. support multiple tables
* 8. fix test
* 9. migrate ddl between table and queue
support switch between the old and new ddl framework, migrate the existing ddl job between queue and table
* 10. check tikv version and set reorg worker count according cpu count
* *: add featuretag on tests
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com >
* use a determined table id for 3 tables
* remove ctx value
* add GetSchemaVersionWithNonEmptyDiff function
* address tangenta and zimulala comment
* use only one etcd path
* make ActionRenameTable support multi-schema
* reset sql digest to make top sql work correct
* add comment
* fix test
* remove 0 for schema version lock
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com >
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io >
Co-authored-by: wjHuang <huangwenjun1997@gmail.com >
2022-07-20 21:20:07 +08:00
63f5d286ff
log-backup: add version check for pitr ( #36268 )
...
close pingcap/tidb#36267
2022-07-18 23:27:07 +08:00
98595124b2
log-backup: added more metrics and hint; fixed a bug may cause inf loop ( #36228 )
...
ref pingcap/tidb#29501
2022-07-18 22:17:07 +08:00
48830de368
*: update client-go to improve performance for sortRegion ( #36275 )
2022-07-18 17:49:08 +08:00
0d6741039a
log-backup: calculate global checkpoint-ts from storage ( #36255 )
...
close pingcap/tidb#36246
2022-07-18 14:09:07 +08:00
1883a4444d
br: restore privilege tables on full restore by default ( #35397 )
...
close pingcap/tidb#35395
2022-07-18 13:11:06 +08:00
f47978c3c2
log-backup: add the switch for log backup ( #36115 )
...
ref pingcap/tidb#29501
2022-07-15 14:31:06 +08:00
1885ebfaf0
log-backup: get can restored global-checkpoint-ts when support v3 checkpoint advance ( #36197 )
...
close pingcap/tidb#29501
2022-07-13 23:37:05 +08:00
f581ec3a45
test: remove meaningless test and update bazel ( #36136 )
2022-07-13 16:41:05 +08:00
fee2a12d69
log-backup: implement the checkpoint V3 ( #36114 )
...
close pingcap/tidb#35164
2022-07-13 11:07:05 +08:00
d214d3eec5
log-backup: support calculating dynamic shift-start-ts when restoring kv-files belonging to default-cf ( #36151 )
...
close pingcap/tidb#36138
2022-07-12 22:39:06 +08:00
4f229f29c3
br: deal with mddljob when pitr restores ( #35976 ) ( #36118 )
...
close pingcap/tidb#35372
2022-07-12 20:13:05 +08:00
354cb537aa
backup-log: support the new feature PiTR- backup/restore log at the tikv endpoint ( #36031 )
...
close pingcap/tidb#29501
2022-07-11 18:17:05 +08:00
600fa2ec31
log-backup: fix default ts not passed tz check ( #35907 )
...
ref pingcap/tidb#31975
2022-07-11 10:41:04 +08:00
55aea2787d
*: use pdqsort to improve sort performance ( #34404 )
...
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
d8dbab23cc
br: optimize communication with tikv stores. #31722 ( #35147 )
...
close pingcap/tidb#31722
2022-07-05 13:43:02 +08:00
e50b9430fc
*: enable gci ( #35823 )
...
ref pingcap/tidb#35345
2022-07-04 14:53:02 +08:00
5eac3b6999
log-backup: check timezone when using datatime format ts string ( #35811 )
...
ref pingcap/tidb#31975
2022-06-29 17:20:40 +08:00
fde7c36e10
raw_restore: fix the issue that raw restore rewrite the t prefix keys ( #35641 )
...
close pingcap/tidb#35279
2022-06-23 20:06:37 +08:00
f5d3b0272c
br: return given error and wait retry when failed to ScanRegions ( #35339 )
...
close pingcap/tidb#35211
2022-06-14 14:12:33 +08:00
c1728d7de1
br: add summary to stream restore ( #35237 )
...
close pingcap/tidb#35236
2022-06-09 18:08:30 +08:00
6432975be3
*: enable race test on util/chunk and update bazel config ( #35235 )
...
ref pingcap/tidb#35234
2022-06-09 16:32:31 +08:00
7846d1e83c
BR: fix Unit test TestconfigureRestoreClient ( #35214 )
...
close pingcap/tidb#35209
2022-06-08 17:00:31 +08:00
2b4a4c6d7a
*: support bazel ( #33691 )
...
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
5ee0957cbb
BR: fix case sensitive issue in CheckRestoreDBAndTable ( #32400 ) ( #34912 )
...
close pingcap/tidb#32400
2022-05-31 00:56:26 +08:00
76cc528baf
pitr: Compatible with tiflash ( #34776 )
...
close pingcap/tidb#34777
2022-05-18 20:26:39 +08:00
2faac4f507
br: filter (start-ts, restore-ts) when restore data kv ( #34703 )
...
close pingcap/tidb#33873
2022-05-18 13:52:37 +08:00
6207978549
log-backup: sleep on every retryable error. ( #34700 )
...
ref pingcap/tidb#31979
2022-05-17 19:24:37 +08:00
89bbe78203
br: save global checkpoint to storage and support complete transaction ( #34612 )
...
close pingcap/tidb#34632
2022-05-14 17:02:35 +08:00
096ec51cd6
br: use the correct status address ( #34650 )
...
close pingcap/tidb#34651
2022-05-14 15:22:35 +08:00
c68b6172d9
restore: Auto set region split size/keys from tikv ( #34605 )
...
close pingcap/tidb#34370
2022-05-13 21:56:37 +08:00
19b85656d8
*: use generics to improve Clamp ( #34586 )
...
close pingcap/tidb#34588
2022-05-13 17:28:35 +08:00
c6fe032e99
br: support PiTR feature ( #34409 )
...
ref pingcap/tidb#29501
2022-05-12 17:08:35 +08:00
9339955f0d
backup: backup empty databases ( #34385 )
...
close pingcap/tidb#33866
2022-05-07 18:30:32 +08:00
f88dab92f9
util: use generics to implement max/min ( #34197 )
...
close pingcap/tidb#34247
2022-05-06 10:08:57 +08:00
2578630108
br: enhance the error infomation ( #33882 )
...
close pingcap/tidb#33598
2022-04-21 21:54:04 +08:00
8f8dfafc10
br: Fix new collaction enable check ( #33500 )
...
* add glue to get global variables
2022-03-28 21:16:53 +08:00
11db011054
br: Ignore ddl jobs with empty query or blacklist type when exec restore ( #33384 )
...
close pingcap/tidb#33322
2022-03-28 18:00:28 +08:00
6517ee3fb6
*: migrate tidb-tools ( #33296 )
...
close pingcap/tidb#32999
2022-03-25 19:08:35 +08:00
815a5375fd
br: Add comment to filterRestoreFiles function ( #33353 )
...
close pingcap/tidb#33352
2022-03-24 17:12:33 +08:00
e130e52290
restore: allow restore accross one major version ( #33203 )
...
close pingcap/tidb#33182
2022-03-17 20:42:31 +08:00
dcafe8ec71
br: download sst again with no-crypt parameters when met decryption error for downloadSST ( #32847 )
...
close pingcap/tidb#32423
2022-03-17 14:00:30 +08:00
e0db77ecd1
br: implement backup & restore policy info ( #33007 )
...
close pingcap/tidb#32290
2022-03-15 17:39:53 +08:00
4e69c0705e
br: Fix backup rawkv failure ( #32612 )
...
close pingcap/tidb#32607
2022-03-03 15:05:47 +08:00
5988d0b2f4
*: update client-go and etcd version ( #32457 )
...
close pingcap/tidb#32456
2022-02-22 11:11:43 +08:00
88e9f682bf
br: refactor restore client configuration ( #31940 )
...
close pingcap/tidb#31906
2022-02-11 16:55:37 +08:00
