Commit Graph

553 Commits

Author SHA1 Message Date
4e4169bcc5 *: support global memory control for tidb (#37794)
ref pingcap/tidb#37816
2022-09-26 12:01:43 +08:00
805ca3e9c1 *: close resultsets (#38146) 2022-09-26 11:25:43 +08:00
4e1860b97c log-backup: Refactor daemon (#36763)
close pingcap/tidb#36762
2022-09-23 17:25:42 +08:00
319b32005e DDL: update TiFlash replica progress after available (#37766)
ref pingcap/tiflash#4902
2022-09-22 20:11:03 +08:00
1eeedacc60 *: remove goleak's ignoring opencensus top function (#37908) 2022-09-19 12:29:00 +08:00
c4638b70fd *: support metadata lock (#37393)
ref pingcap/tidb#37275
2022-09-18 20:57:00 +08:00
bb782fe0f3 *: small refactoring for metadata lock (#37648) 2022-09-08 16:26:56 +08:00
29591587c7 linter: fix unconvert output (#37663) 2022-09-07 18:06:57 +08:00
4cb0d1f7a0 ddl: Delete TiFlash sync status from etcd when table is truncated or dropped (#37184)
close pingcap/tidb#37168
2022-09-07 16:28:56 +08:00
36b6710c64 executor: disable closest replica read if cluster is not balanced (#36824)
ref pingcap/tidb#35926
2022-09-07 11:28:56 +08:00
c372adb7a8 planner: refactor PrepareExecutor (#37519)
ref pingcap/tidb#36598
2022-09-01 18:10:25 +08:00
a04000cd89 *: merge feature/flashback-cluster to master (#37529)
ref pingcap/tidb#37197
2022-09-01 10:58:24 +08:00
00f6fed60f domain: fix unstable subTestSchemaValidatorGeneral (#37447)
ref pingcap/tidb#37277
2022-08-30 15:44:23 +08:00
ccd4f347a2 *: Enable tiflash_fastscan variable and remove fast mode alter statment (#37027)
ref pingcap/tidb#35850
2022-08-29 11:28:22 +08:00
f5d3df3667 *: change integration.BeforeTest to integration.BeforeTestExternal to avoid skip tests (#37341)
close pingcap/tidb#37340
2022-08-25 14:58:21 +08:00
a43bc8c8ea *: fix data race in TestTiFlashGroupIndexWhenStartup (#37371)
close pingcap/tidb#37370
2022-08-25 11:48:21 +08:00
d1f75f0dd9 ddl: set tiflash placement group index to 120 (#37179)
ref pingcap/tidb#37171
2022-08-19 15:50:54 +08:00
44f684ec77 *: only create TemporaryTableAttachedInfoSchema if needed (#37196)
close pingcap/tidb#37195
2022-08-18 18:34:51 +08:00
257c78764d test: fix race for SetDDL by moving ddl inject earlier (#36964)
close pingcap/tidb#36940
2022-08-09 10:36:47 +08:00
92e9192ecc *: fix not bootstrapped error on playground (#36919)
close pingcap/tidb#36917
2022-08-05 18:08:06 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
0b1ad27b1a server: skip check tiflash version (#36451)
close pingcap/tidb#36449
2022-07-22 13:01:09 +08:00
e2ab4313d2 log-backup: removed log-backup related configs (#36315)
ref pingcap/tidb#29501
2022-07-21 02:25:08 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
11625d46af domain: fix unstable test (#36308)
close pingcap/tidb#36310
2022-07-19 15:25:07 +08:00
8af8341cca planner: Table scan in TiFlash not keep order (#36232)
close pingcap/tidb#36231
2022-07-19 00:51:07 +08:00
98595124b2 log-backup: added more metrics and hint; fixed a bug may cause inf loop (#36228)
ref pingcap/tidb#29501
2022-07-18 22:17:07 +08:00
911e7cc360 *: enable revive (#35970)
ref pingcap/tidb#35345
2022-07-15 16:03:06 +08:00
9a2ed52119 server, sessionctx: support token-based authentication (#36152)
close pingcap/tidb#35913
2022-07-14 18:29:06 +08:00
f2823250fb domain: fix unstable test TestAbnormalSessionPool (#36154)
close pingcap/tidb#36153
2022-07-13 20:07:05 +08:00
f581ec3a45 test: remove meaningless test and update bazel (#36136) 2022-07-13 16:41:05 +08:00
fee2a12d69 log-backup: implement the checkpoint V3 (#36114)
close pingcap/tidb#35164
2022-07-13 11:07:05 +08:00
49b4bf96bd ddl: implement Schema level API for DM SchemaTracker (#35991)
ref pingcap/tidb#35933
2022-07-11 11:31:05 +08:00
6e22e47f06 parser,ddl: support 'set tiflash mode' ddl and support check tiflash mode in tiflash_replica table (#35851)
ref pingcap/tidb#35850
2022-07-07 15:15:03 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
11f39cd77a txn: unify the management of transaction activation by TxnManager. (#35679)
close pingcap/tidb#35705
2022-06-30 13:40:39 +08:00
f53e3c72cc ddl: for schema-level DDL method parameter is now XXXStmt (#35722)
ref pingcap/tidb#35665, close pingcap/tidb#35734
2022-06-27 10:54:38 +08:00
bd848d4509 *: move some tests and make some changes (#35450)
ref pingcap/tidb#32031
2022-06-16 21:18:34 +08:00
a523d767f8 infosync: fix data race in the mockTiFlashPlacementManager (#35183)
close pingcap/tidb#35182
2022-06-07 17:12:30 +08:00
2b4a4c6d7a *: support bazel (#33691)
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
c5393d0367 *: use pdqsort to sort and remove BCE (#35087)
ref pingcap/tidb#34250
2022-06-01 10:48:27 +08:00
bf435dd4e6 variable: refresh sysvar cache for tidb_gc_max_wait_time (#34967)
close pingcap/tidb#34966
2022-05-26 16:38:47 +08:00
eae2ae84f4 *: move config file option tidb_enable_auto_analyze to sysvar (#34643)
ref pingcap/tidb#33769
2022-05-19 02:34:38 +08:00
01fb9355d6 executor: add ALTER TABLE COMPACT support (#34741)
ref pingcap/tidb#34749
2022-05-19 00:44:38 +08:00
c154d4f864 variable: fix 34773 race error (#34775)
close pingcap/tidb#34773
2022-05-18 15:44:38 +08:00
95e359ff4c variable: revise TiDBStatsCacheMemQuota settting code (#34762)
ref pingcap/tidb#34052
2022-05-18 13:26:38 +08:00
810f8ae12e *: remove pingcap/check dependency (#34734)
close pingcap/tidb#28328
2022-05-17 21:38:37 +08:00
a3193a88c1 *: change global kill config and add telemetry (#34733)
ref pingcap/tidb#8854
2022-05-17 21:20:38 +08:00