Commit Graph

276 Commits

Author SHA1 Message Date
76153ab9ff lint: update config of deprecated linter (#40763)
ref pingcap/tidb#40786
2023-01-28 11:57:53 +08:00
787cb27265 meta: add lock at autoid.(*allocator).Base() (#40588)
close pingcap/tidb#40584
2023-01-18 00:43:59 +08:00
b477b1c946 *: Supports create/alter/drop resource group (#40188)
ref pingcap/tidb#38825
2023-01-09 13:44:22 +08:00
1f344ba108 autoid_service: add unit test for the package (#40193) 2023-01-03 19:40:19 +08:00
f7de8beede *: remove the support of the old ddl framework (#39684)
ref pingcap/tidb#39824
2022-12-30 18:30:18 +08:00
9488ca9db6 *: Add backfill job related tables and operations (#39616)
close pingcap/tidb#37122
2022-12-12 14:34:51 +08:00
272d3284ed meta/autoid: fix AUTO_ID_CACHE 1 setting affect row id allocator performance (#39534)
close pingcap/tidb#39528
2022-12-02 05:56:00 +08:00
a00f0fe28e autoid_service,meta/autoid: distinguish retriable error from non-retriable error (#39215)
close pingcap/tidb#39214
2022-11-30 16:40:01 +08:00
19dae1fa73 *: separate auto_increment ID allocator from _tidb_rowid allocator when AUTO_ID_CACHE=1 (#39041)
close pingcap/tidb#982
2022-11-29 20:20:00 +08:00
9689b4763d ddl: improve log messages (#39376) 2022-11-29 17:15:59 +08:00
ba16dba2c2 *: use a key to decide mdl is enabled or not (#39154) 2022-11-17 18:43:57 +08:00
12d9644144 *: support mysql compatible auto_increment, the client side changes (#38809) 2022-11-04 09:36:00 +08:00
f9c7bbccec *: authentication using tidb_auth_token plugin (#38773)
close pingcap/tidb#38504
2022-11-04 02:54:00 +08:00
cd531a4a98 *: support auto_random on composite clustered primary key (#38617)
close pingcap/tidb#38572
2022-10-27 10:45:57 +08:00
4bdd20b540 *: support 2-phases flashback cluster (#38164)
ref pingcap/tidb#37961, close pingcap/tidb#38554
2022-10-26 17:01:58 +08:00
400f585578 br/restore: try keep table ID when possible (#38033)
close pingcap/tidb#38438
2022-10-14 12:21:52 +08:00
8f18fcece0 *: delete mInFlashbackCluster related codes (#38241)
ref pingcap/tidb#37197
2022-09-30 12:15:45 +08:00
c4638b70fd *: support metadata lock (#37393)
ref pingcap/tidb#37275
2022-09-18 20:57:00 +08:00
51e6536c48 ddl, meta: check flashback history time range (#37737)
close pingcap/tidb#37585
2022-09-14 17:50:59 +08:00
a04000cd89 *: merge feature/flashback-cluster to master (#37529)
ref pingcap/tidb#37197
2022-09-01 10:58:24 +08:00
d0f8487dea *: support specifying range bits for auto_random (#36860)
close pingcap/tidb#32508
2022-08-16 20:54:50 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
70f35617f6 *: optimize DDL history http API, reduce memory (#36859)
close pingcap/tidb#35838
2022-08-04 11:56:05 +08:00
97f66c3fec *: use tidb version to decide insert internal DDL into queue or table (#36782)
close pingcap/tidb#36761
2022-08-02 21:12:06 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
04228632f6 table, meta: fix auto_increment initialization for temporary tables (#36319)
close pingcap/tidb#36224
2022-07-21 00:49:08 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
911e7cc360 *: enable revive (#35970)
ref pingcap/tidb#35345
2022-07-15 16:03:06 +08:00
26e117056b ddl: move ddl test (#36005) 2022-07-07 17:43:02 +08:00
ec9f201294 topsql: compress plan instead of dropping it (#35973)
ref pingcap/tidb#35964
2022-07-06 16:03:02 +08:00
55aea2787d *: use pdqsort to improve sort performance (#34404)
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
637d00c05a ddl: refine history job code (#35967) 2022-07-06 11:43:02 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
d3e9114f44 *: enable more flaky test, enable more shard_count and update bazel config (#35300)
ref pingcap/tidb#35247
2022-06-13 17:52:32 +08:00
2b4a4c6d7a *: support bazel (#33691)
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
15711231be ddl: use reorg handler to manage the reorganization information of DDL job (#35030)
ref pingcap/tidb#32031
2022-06-01 13:42:27 +08:00
eb46685055 *: add methods to session.Context and refactor some code about ddl (#34699)
close pingcap/tidb#32031
2022-05-30 12:46:26 +08:00
76cc528baf pitr: Compatible with tiflash (#34776)
close pingcap/tidb#34777
2022-05-18 20:26:39 +08:00
810f8ae12e *: remove pingcap/check dependency (#34734)
close pingcap/tidb#28328
2022-05-17 21:38:37 +08:00
c6fe032e99 br: support PiTR feature (#34409)
ref pingcap/tidb#29501
2022-05-12 17:08:35 +08:00
c16291392a *: replace types.NewFieldTypeBuilder() API with NewFieldTypeBuilderP() to avoid misuse (#34494)
close pingcap/tidb#34490
2022-05-09 22:00:33 +08:00
f88dab92f9 util: use generics to implement max/min (#34197)
close pingcap/tidb#34247
2022-05-06 10:08:57 +08:00
1bf64c60f4 *: Refactor FieldType structure (#33569)
close pingcap/tidb#32116
2022-04-26 19:28:51 +08:00
d282940b42 *: remove syncLog (#33306)
close pingcap/tidb#33305
2022-03-23 13:12:32 +08:00
6b2e37f18c gomod: update dependency for golang1.18 (#33053)
ref pingcap/tidb#32874
2022-03-17 15:10:31 +08:00
3f3a061afe ddl: Add CreatePlacementPolicyWithInfo to ddl.DDL (#32986)
close pingcap/tidb#32951
2022-03-11 11:43:51 +08:00
0c9b0c0ef2 util/testutil: cleanup testutils depend on pingcap/check (#32662)
close pingcap/tidb#32660
2022-02-28 20:01:45 +08:00
5988d0b2f4 *: update client-go and etcd version (#32457)
close pingcap/tidb#32456
2022-02-22 11:11:43 +08:00
c8bef987ae *: support variable tidb_last_ddl_info (#32414)
close pingcap/tidb#32402
2022-02-17 16:43:40 +08:00