Commit Graph

535 Commits

Author SHA1 Message Date
257c78764d test: fix race for SetDDL by moving ddl inject earlier (#36964)
close pingcap/tidb#36940
2022-08-09 10:36:47 +08:00
92e9192ecc *: fix not bootstrapped error on playground (#36919)
close pingcap/tidb#36917
2022-08-05 18:08:06 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
0b1ad27b1a server: skip check tiflash version (#36451)
close pingcap/tidb#36449
2022-07-22 13:01:09 +08:00
e2ab4313d2 log-backup: removed log-backup related configs (#36315)
ref pingcap/tidb#29501
2022-07-21 02:25:08 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
11625d46af domain: fix unstable test (#36308)
close pingcap/tidb#36310
2022-07-19 15:25:07 +08:00
8af8341cca planner: Table scan in TiFlash not keep order (#36232)
close pingcap/tidb#36231
2022-07-19 00:51:07 +08:00
98595124b2 log-backup: added more metrics and hint; fixed a bug may cause inf loop (#36228)
ref pingcap/tidb#29501
2022-07-18 22:17:07 +08:00
911e7cc360 *: enable revive (#35970)
ref pingcap/tidb#35345
2022-07-15 16:03:06 +08:00
9a2ed52119 server, sessionctx: support token-based authentication (#36152)
close pingcap/tidb#35913
2022-07-14 18:29:06 +08:00
f2823250fb domain: fix unstable test TestAbnormalSessionPool (#36154)
close pingcap/tidb#36153
2022-07-13 20:07:05 +08:00
f581ec3a45 test: remove meaningless test and update bazel (#36136) 2022-07-13 16:41:05 +08:00
fee2a12d69 log-backup: implement the checkpoint V3 (#36114)
close pingcap/tidb#35164
2022-07-13 11:07:05 +08:00
49b4bf96bd ddl: implement Schema level API for DM SchemaTracker (#35991)
ref pingcap/tidb#35933
2022-07-11 11:31:05 +08:00
6e22e47f06 parser,ddl: support 'set tiflash mode' ddl and support check tiflash mode in tiflash_replica table (#35851)
ref pingcap/tidb#35850
2022-07-07 15:15:03 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
11f39cd77a txn: unify the management of transaction activation by TxnManager. (#35679)
close pingcap/tidb#35705
2022-06-30 13:40:39 +08:00
f53e3c72cc ddl: for schema-level DDL method parameter is now XXXStmt (#35722)
ref pingcap/tidb#35665, close pingcap/tidb#35734
2022-06-27 10:54:38 +08:00
bd848d4509 *: move some tests and make some changes (#35450)
ref pingcap/tidb#32031
2022-06-16 21:18:34 +08:00
a523d767f8 infosync: fix data race in the mockTiFlashPlacementManager (#35183)
close pingcap/tidb#35182
2022-06-07 17:12:30 +08:00
2b4a4c6d7a *: support bazel (#33691)
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
c5393d0367 *: use pdqsort to sort and remove BCE (#35087)
ref pingcap/tidb#34250
2022-06-01 10:48:27 +08:00
bf435dd4e6 variable: refresh sysvar cache for tidb_gc_max_wait_time (#34967)
close pingcap/tidb#34966
2022-05-26 16:38:47 +08:00
eae2ae84f4 *: move config file option tidb_enable_auto_analyze to sysvar (#34643)
ref pingcap/tidb#33769
2022-05-19 02:34:38 +08:00
01fb9355d6 executor: add ALTER TABLE COMPACT support (#34741)
ref pingcap/tidb#34749
2022-05-19 00:44:38 +08:00
c154d4f864 variable: fix 34773 race error (#34775)
close pingcap/tidb#34773
2022-05-18 15:44:38 +08:00
95e359ff4c variable: revise TiDBStatsCacheMemQuota settting code (#34762)
ref pingcap/tidb#34052
2022-05-18 13:26:38 +08:00
810f8ae12e *: remove pingcap/check dependency (#34734)
close pingcap/tidb#28328
2022-05-17 21:38:37 +08:00
a3193a88c1 *: change global kill config and add telemetry (#34733)
ref pingcap/tidb#8854
2022-05-17 21:20:38 +08:00
586716bff2 statistics: remove stats cache unnecessary lock and revise log (#34726)
* revise log

Signed-off-by: yisaer <disxiaofei@163.com>

* revise log

Signed-off-by: yisaer <disxiaofei@163.com>

* remove lock

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>
2022-05-17 20:58:29 +08:00
53f228af45 sysvari: enable statsCache lru by config (#34278)
* add statsquota variable

Signed-off-by: yisaer <disxiaofei@163.com>

* add test

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

* fix conflict

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

* fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

* fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-05-10 23:49:54 +08:00
20ecaef36d ddl: add require owner interface (#34407)
ref pingcap/tidb#32031
2022-05-09 18:48:33 +08:00
8a2966ce1e *: improve map copy (#34451)
close pingcap/tidb#34454
2022-05-09 11:44:33 +08:00
5b6ffa70cc domain,session: Store and delete internal session in the session pool (#34168)
close pingcap/tidb#34154
2022-04-29 13:54:52 +08:00
91cb86e3cf domain, sessionctx/variable: make code DRY (#33897)
close pingcap/tidb#33896
2022-04-28 20:26:52 +08:00
308be4174d ddl: move some tests to package ddl_test (#34281)
ref pingcap/tidb#34284
2022-04-27 18:32:52 +08:00
2ef7168991 ddl, domain: rewrite testDomain for concurrent DDL (#34221)
ref pingcap/tidb#33008
2022-04-26 20:20:51 +08:00
a5033d14d0 *: use global auto analyze ID in order to kill auto analyze globally (#34075)
close pingcap/tidb#34076
2022-04-20 17:58:03 +08:00
c56c036d2a *: refactor placement bundle in infoschema (#33967)
close pingcap/tidb#33968
2022-04-15 11:04:35 +08:00
45e48b6498 *: Add more grafana charts for pd http api request (#33936)
ref pingcap/tidb#33916
2022-04-14 15:48:36 +08:00
8af7a4d4c0 domain: sync the access of InfoSyncer.SessionManager (#33924)
close pingcap/tidb#33335
2022-04-13 21:26:35 +08:00
5047888271 infosync: improve error log for http client (#33901)
close pingcap/tidb#33900
2022-04-13 14:58:35 +08:00
14f4888fb3 *: Auto refresh PD addrs for PDPlacementManager, PDLabelManager, TiFlashPDPlacementManager (#33909)
close pingcap/tidb#33908
2022-04-13 14:18:35 +08:00
fef98f2239 domain,server,session: optimize gc safepoint advancing for internal transaction (#32726)
close pingcap/tidb#32725
2022-04-07 14:14:32 +08:00
9d44656564 domain: use util.WaitGroupWrapper insteal of sync.WaitGroup (#33637)
ref pingcap/tidb#31716
2022-04-01 23:48:29 +08:00
0f4706418e *: track cluster-level analyze jobs and make it persistent (#32215)
close pingcap/tidb#32403
2022-03-31 21:06:29 +08:00
d4ec94736d *: make txnCommitBatchSize adjustable by SQL (#33507)
close pingcap/tidb#33508
2022-03-30 21:52:29 +08:00