Commit Graph

106 Commits

Author SHA1 Message Date
b477b1c946 *: Supports create/alter/drop resource group (#40188)
ref pingcap/tidb#38825
2023-01-09 13:44:22 +08:00
0fe61bd41a *: prevent cursor read from being cancelled by GC (#39950)
close pingcap/tidb#39447
2022-12-16 16:12:52 +08:00
c9bb2f2bb8 domain: disable closest-adaptive dynamically to make read traffic more even (#38960)
ref pingcap/tidb#35926
2022-11-22 18:51:58 +08:00
f9c7bbccec *: authentication using tidb_auth_token plugin (#38773)
close pingcap/tidb#38504
2022-11-04 02:54:00 +08:00
835518122e DDL: Remove TiFlash replica progress etcd dependency (#38564)
close pingcap/tidb#38464
2022-10-31 13:37:59 +08:00
e415cfa5f4 DDL: use new PD API to get TiFlash replica table regionCount (#38571)
close pingcap/tidb#38570
2022-10-28 18:17:57 +08:00
c52b5a70d1 DDL: delete partition table tiflash replica progress from ETCD when truncate table, drop table, set tiflash replica 0 (#38551)
close pingcap/tidb#38550
2022-10-20 18:15:55 +08:00
805ca3e9c1 *: close resultsets (#38146) 2022-09-26 11:25:43 +08:00
319b32005e DDL: update TiFlash replica progress after available (#37766)
ref pingcap/tiflash#4902
2022-09-22 20:11:03 +08:00
bb782fe0f3 *: small refactoring for metadata lock (#37648) 2022-09-08 16:26:56 +08:00
4cb0d1f7a0 ddl: Delete TiFlash sync status from etcd when table is truncated or dropped (#37184)
close pingcap/tidb#37168
2022-09-07 16:28:56 +08:00
36b6710c64 executor: disable closest replica read if cluster is not balanced (#36824)
ref pingcap/tidb#35926
2022-09-07 11:28:56 +08:00
c372adb7a8 planner: refactor PrepareExecutor (#37519)
ref pingcap/tidb#36598
2022-09-01 18:10:25 +08:00
a04000cd89 *: merge feature/flashback-cluster to master (#37529)
ref pingcap/tidb#37197
2022-09-01 10:58:24 +08:00
f5d3df3667 *: change integration.BeforeTest to integration.BeforeTestExternal to avoid skip tests (#37341)
close pingcap/tidb#37340
2022-08-25 14:58:21 +08:00
a43bc8c8ea *: fix data race in TestTiFlashGroupIndexWhenStartup (#37371)
close pingcap/tidb#37370
2022-08-25 11:48:21 +08:00
d1f75f0dd9 ddl: set tiflash placement group index to 120 (#37179)
ref pingcap/tidb#37171
2022-08-19 15:50:54 +08:00
92e9192ecc *: fix not bootstrapped error on playground (#36919)
close pingcap/tidb#36917
2022-08-05 18:08:06 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
0b1ad27b1a server: skip check tiflash version (#36451)
close pingcap/tidb#36449
2022-07-22 13:01:09 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
f2823250fb domain: fix unstable test TestAbnormalSessionPool (#36154)
close pingcap/tidb#36153
2022-07-13 20:07:05 +08:00
a523d767f8 infosync: fix data race in the mockTiFlashPlacementManager (#35183)
close pingcap/tidb#35182
2022-06-07 17:12:30 +08:00
2b4a4c6d7a *: support bazel (#33691)
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
bf435dd4e6 variable: refresh sysvar cache for tidb_gc_max_wait_time (#34967)
close pingcap/tidb#34966
2022-05-26 16:38:47 +08:00
810f8ae12e *: remove pingcap/check dependency (#34734)
close pingcap/tidb#28328
2022-05-17 21:38:37 +08:00
20ecaef36d ddl: add require owner interface (#34407)
ref pingcap/tidb#32031
2022-05-09 18:48:33 +08:00
45e48b6498 *: Add more grafana charts for pd http api request (#33936)
ref pingcap/tidb#33916
2022-04-14 15:48:36 +08:00
8af7a4d4c0 domain: sync the access of InfoSyncer.SessionManager (#33924)
close pingcap/tidb#33335
2022-04-13 21:26:35 +08:00
5047888271 infosync: improve error log for http client (#33901)
close pingcap/tidb#33900
2022-04-13 14:58:35 +08:00
14f4888fb3 *: Auto refresh PD addrs for PDPlacementManager, PDLabelManager, TiFlashPDPlacementManager (#33909)
close pingcap/tidb#33908
2022-04-13 14:18:35 +08:00
fef98f2239 domain,server,session: optimize gc safepoint advancing for internal transaction (#32726)
close pingcap/tidb#32725
2022-04-07 14:14:32 +08:00
6b2e37f18c gomod: update dependency for golang1.18 (#33053)
ref pingcap/tidb#32874
2022-03-17 15:10:31 +08:00
7fcdab6002 ddl: add limiter when setting TiFlash replicas for all tables in a database (#32526)
ref pingcap/tidb#32254
2022-03-11 10:47:50 +08:00
55d0f126ee ddl: implement backoff pool for TiFlash Cluster Management (#32317)
ref pingcap/tidb#32254
2022-03-04 11:31:46 +08:00
5988d0b2f4 *: update client-go and etcd version (#32457)
close pingcap/tidb#32456
2022-02-22 11:11:43 +08:00
e0f90a7c11 ddl: fix string truncating when tiflash/sync-status returns a very long line (#32367)
close pingcap/tidb#32356
2022-02-18 12:33:40 +08:00
638fa8e22f ddl: fix error that pd rules are not deleted when alter TiFlash replica count to 0 (#32192)
close pingcap/tidb#32190
2022-02-10 17:53:36 +08:00
c30e8320d8 *: correct use require (#31904)
ref pingcap/tidb#31716
2022-02-07 18:11:35 +08:00
6a53a03fad *: fix extra warnings about MockTiFlash (#31916)
close pingcap/tidb#31909
2022-01-26 20:08:45 +08:00
3c797fdc64 *: fix data races in from MockTiFlash (#31836)
close pingcap/tidb#31830
2022-01-25 16:56:11 +08:00
493fe783d7 ddl: Implement basic version of TiFlash replica management (#30842) 2022-01-19 15:13:46 +08:00
xhe
84e0518344 executor: show better placement schedule state (#31073)
close pingcap/tidb#30960
2022-01-09 22:16:38 +08:00
ec4da9840d ddl: Wrap TiFlash and its pd rule management into InfoSyncer (#31315)
ref pingcap/tidb#29924
2022-01-06 13:56:37 +08:00
3de13842b3 test: control log level with environment variables (#30871) 2021-12-24 17:03:48 +08:00
feee7c258a server: Add uptime status var and statistics (#29790)
close pingcap/tidb#8842
2021-12-21 17:53:48 +08:00
89fd69788d *: Retry when placement PutBundles failed (#30590) 2021-12-10 09:35:57 +08:00
7d4895fa96 infosync: close body when ReadAll encounters error (#30462) 2021-12-07 13:27:55 +08:00
0a92c4d133 store: Add metrics for pd api call time (#30062) 2021-12-01 18:49:53 +08:00
d3a4187f7e *: Make PD placement api as an interface and add some mock codes (#29696)
* *: Make PD placement api as an interface and add some mock codes

* modify

* add comments

Co-authored-by: Arenatlx <314806019@qq.com>
2021-11-15 14:08:56 +08:00