14f9b043cb
br: add an example in timezone-check error message ( #36895 )
...
ref pingcap/tidb#36717
2022-08-18 14:42:52 +08:00
d6d0ce7b10
*: gofmt code for adapting go 1.19 ( #36832 )
...
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
5b4a82dbf4
*: upgrade bazel timeout ( #36776 )
2022-08-02 11:10:05 +08:00
158ba1a1d9
*: enable part revive for all code ( #36703 )
2022-08-01 14:02:06 +08:00
1fe666add6
*: upgrade staticcheck ( #36745 )
2022-08-01 11:58:05 +08:00
cb211e0edf
br: add flag to control whether restore priv table on default ( #36652 )
...
close pingcap/tidb#36651
2022-07-30 16:40:03 +08:00
90e9b63a29
log-backup: format the date displayed in --help ( #36713 )
...
close pingcap/tidb#36717
2022-07-29 20:33:13 +08:00
3df01375c0
log-backup: filter out unnecessary metadata files ( #36656 )
...
close pingcap/tidb#36648
2022-07-29 14:59:13 +08:00
7a47538f4e
br: enhance the output infomation ( #36676 )
...
ref pingcap/tidb#29501
2022-07-29 13:25:11 +08:00
56dadec862
ddl: Preparation for add index acceleration ( #36085 )
...
ref pingcap/tidb#35983
2022-07-28 16:43:11 +08:00
9b7060393e
log-backup: fixed bugs about log truncate left some files and log truncate update log-min-date ( #36616 )
...
close pingcap/tidb#36376 , ref pingcap/tidb#36533 , ref pingcap/tidb#36535
2022-07-28 13:13:10 +08:00
6ae88c4309
br: use one shot session to close domain ASAP ( #36558 )
...
* br: use one shot session to close domain ASAP
Co-authored-by: Ian <ArGregoryIan@gmail.com >
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io >
2022-07-26 20:15:53 +08:00
bf743a6ca0
*: enable flaky test for all test ( #36385 )
...
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
6c704f756f
log-backup: remove the timezone from log-date ( #36369 )
...
close pingcap/tidb#36370
2022-07-21 20:01:09 +08:00
656b5a5e80
br: fix broken integration test ( #36411 )
2022-07-21 16:49:09 +08:00
ab513bf0ca
ddl: support concurrent ddl ( #32169 )
...
* 1. init ddl tables
create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table
* 2. setup concurrent ddl env and add ddl worker pool
adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute
* 3. add ddl manager to handle ddl job
* 4. reorg handler for concurrent ddl
just implements the partner of the reorg information.
* 5. manage ddl jobs for concurrent ddl
add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller
* 6. add metrics for concurrent ddl
add metrics
* 7. support multiple tables
* 8. fix test
* 9. migrate ddl between table and queue
support switch between the old and new ddl framework, migrate the existing ddl job between queue and table
* 10. check tikv version and set reorg worker count according cpu count
* *: add featuretag on tests
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com >
* use a determined table id for 3 tables
* remove ctx value
* add GetSchemaVersionWithNonEmptyDiff function
* address tangenta and zimulala comment
* use only one etcd path
* make ActionRenameTable support multi-schema
* reset sql digest to make top sql work correct
* add comment
* fix test
* remove 0 for schema version lock
Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com >
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io >
Co-authored-by: wjHuang <huangwenjun1997@gmail.com >
2022-07-20 21:20:07 +08:00
63f5d286ff
log-backup: add version check for pitr ( #36268 )
...
close pingcap/tidb#36267
2022-07-18 23:27:07 +08:00
98595124b2
log-backup: added more metrics and hint; fixed a bug may cause inf loop ( #36228 )
...
ref pingcap/tidb#29501
2022-07-18 22:17:07 +08:00
48830de368
*: update client-go to improve performance for sortRegion ( #36275 )
2022-07-18 17:49:08 +08:00
0d6741039a
log-backup: calculate global checkpoint-ts from storage ( #36255 )
...
close pingcap/tidb#36246
2022-07-18 14:09:07 +08:00
1883a4444d
br: restore privilege tables on full restore by default ( #35397 )
...
close pingcap/tidb#35395
2022-07-18 13:11:06 +08:00
f47978c3c2
log-backup: add the switch for log backup ( #36115 )
...
ref pingcap/tidb#29501
2022-07-15 14:31:06 +08:00
1885ebfaf0
log-backup: get can restored global-checkpoint-ts when support v3 checkpoint advance ( #36197 )
...
close pingcap/tidb#29501
2022-07-13 23:37:05 +08:00
f581ec3a45
test: remove meaningless test and update bazel ( #36136 )
2022-07-13 16:41:05 +08:00
fee2a12d69
log-backup: implement the checkpoint V3 ( #36114 )
...
close pingcap/tidb#35164
2022-07-13 11:07:05 +08:00
d214d3eec5
log-backup: support calculating dynamic shift-start-ts when restoring kv-files belonging to default-cf ( #36151 )
...
close pingcap/tidb#36138
2022-07-12 22:39:06 +08:00
4f229f29c3
br: deal with mddljob when pitr restores ( #35976 ) ( #36118 )
...
close pingcap/tidb#35372
2022-07-12 20:13:05 +08:00
354cb537aa
backup-log: support the new feature PiTR- backup/restore log at the tikv endpoint ( #36031 )
...
close pingcap/tidb#29501
2022-07-11 18:17:05 +08:00
600fa2ec31
log-backup: fix default ts not passed tz check ( #35907 )
...
ref pingcap/tidb#31975
2022-07-11 10:41:04 +08:00
55aea2787d
*: use pdqsort to improve sort performance ( #34404 )
...
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
d8dbab23cc
br: optimize communication with tikv stores. #31722 ( #35147 )
...
close pingcap/tidb#31722
2022-07-05 13:43:02 +08:00
e50b9430fc
*: enable gci ( #35823 )
...
ref pingcap/tidb#35345
2022-07-04 14:53:02 +08:00
5eac3b6999
log-backup: check timezone when using datatime format ts string ( #35811 )
...
ref pingcap/tidb#31975
2022-06-29 17:20:40 +08:00
fde7c36e10
raw_restore: fix the issue that raw restore rewrite the t prefix keys ( #35641 )
...
close pingcap/tidb#35279
2022-06-23 20:06:37 +08:00
f5d3b0272c
br: return given error and wait retry when failed to ScanRegions ( #35339 )
...
close pingcap/tidb#35211
2022-06-14 14:12:33 +08:00
c1728d7de1
br: add summary to stream restore ( #35237 )
...
close pingcap/tidb#35236
2022-06-09 18:08:30 +08:00
6432975be3
*: enable race test on util/chunk and update bazel config ( #35235 )
...
ref pingcap/tidb#35234
2022-06-09 16:32:31 +08:00
7846d1e83c
BR: fix Unit test TestconfigureRestoreClient ( #35214 )
...
close pingcap/tidb#35209
2022-06-08 17:00:31 +08:00
2b4a4c6d7a
*: support bazel ( #33691 )
...
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
5ee0957cbb
BR: fix case sensitive issue in CheckRestoreDBAndTable ( #32400 ) ( #34912 )
...
close pingcap/tidb#32400
2022-05-31 00:56:26 +08:00
76cc528baf
pitr: Compatible with tiflash ( #34776 )
...
close pingcap/tidb#34777
2022-05-18 20:26:39 +08:00
2faac4f507
br: filter (start-ts, restore-ts) when restore data kv ( #34703 )
...
close pingcap/tidb#33873
2022-05-18 13:52:37 +08:00
6207978549
log-backup: sleep on every retryable error. ( #34700 )
...
ref pingcap/tidb#31979
2022-05-17 19:24:37 +08:00
89bbe78203
br: save global checkpoint to storage and support complete transaction ( #34612 )
...
close pingcap/tidb#34632
2022-05-14 17:02:35 +08:00
096ec51cd6
br: use the correct status address ( #34650 )
...
close pingcap/tidb#34651
2022-05-14 15:22:35 +08:00
c68b6172d9
restore: Auto set region split size/keys from tikv ( #34605 )
...
close pingcap/tidb#34370
2022-05-13 21:56:37 +08:00
19b85656d8
*: use generics to improve Clamp ( #34586 )
...
close pingcap/tidb#34588
2022-05-13 17:28:35 +08:00
c6fe032e99
br: support PiTR feature ( #34409 )
...
ref pingcap/tidb#29501
2022-05-12 17:08:35 +08:00
9339955f0d
backup: backup empty databases ( #34385 )
...
close pingcap/tidb#33866
2022-05-07 18:30:32 +08:00
f88dab92f9
util: use generics to implement max/min ( #34197 )
...
close pingcap/tidb#34247
2022-05-06 10:08:57 +08:00
