Commit Graph

256 Commits

Author SHA1 Message Date
d0f8487dea *: support specifying range bits for auto_random (#36860)
close pingcap/tidb#32508
2022-08-16 20:54:50 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
70f35617f6 *: optimize DDL history http API, reduce memory (#36859)
close pingcap/tidb#35838
2022-08-04 11:56:05 +08:00
97f66c3fec *: use tidb version to decide insert internal DDL into queue or table (#36782)
close pingcap/tidb#36761
2022-08-02 21:12:06 +08:00
5b4a82dbf4 *: upgrade bazel timeout (#36776) 2022-08-02 11:10:05 +08:00
bf743a6ca0 *: enable flaky test for all test (#36385)
close pingcap/tidb#36404
2022-07-22 15:35:09 +08:00
04228632f6 table, meta: fix auto_increment initialization for temporary tables (#36319)
close pingcap/tidb#36224
2022-07-21 00:49:08 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
911e7cc360 *: enable revive (#35970)
ref pingcap/tidb#35345
2022-07-15 16:03:06 +08:00
26e117056b ddl: move ddl test (#36005) 2022-07-07 17:43:02 +08:00
ec9f201294 topsql: compress plan instead of dropping it (#35973)
ref pingcap/tidb#35964
2022-07-06 16:03:02 +08:00
55aea2787d *: use pdqsort to improve sort performance (#34404)
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
637d00c05a ddl: refine history job code (#35967) 2022-07-06 11:43:02 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
d3e9114f44 *: enable more flaky test, enable more shard_count and update bazel config (#35300)
ref pingcap/tidb#35247
2022-06-13 17:52:32 +08:00
2b4a4c6d7a *: support bazel (#33691)
close pingcap/tidb#34083
2022-06-07 15:22:30 +08:00
15711231be ddl: use reorg handler to manage the reorganization information of DDL job (#35030)
ref pingcap/tidb#32031
2022-06-01 13:42:27 +08:00
eb46685055 *: add methods to session.Context and refactor some code about ddl (#34699)
close pingcap/tidb#32031
2022-05-30 12:46:26 +08:00
76cc528baf pitr: Compatible with tiflash (#34776)
close pingcap/tidb#34777
2022-05-18 20:26:39 +08:00
810f8ae12e *: remove pingcap/check dependency (#34734)
close pingcap/tidb#28328
2022-05-17 21:38:37 +08:00
c6fe032e99 br: support PiTR feature (#34409)
ref pingcap/tidb#29501
2022-05-12 17:08:35 +08:00
c16291392a *: replace types.NewFieldTypeBuilder() API with NewFieldTypeBuilderP() to avoid misuse (#34494)
close pingcap/tidb#34490
2022-05-09 22:00:33 +08:00
f88dab92f9 util: use generics to implement max/min (#34197)
close pingcap/tidb#34247
2022-05-06 10:08:57 +08:00
1bf64c60f4 *: Refactor FieldType structure (#33569)
close pingcap/tidb#32116
2022-04-26 19:28:51 +08:00
d282940b42 *: remove syncLog (#33306)
close pingcap/tidb#33305
2022-03-23 13:12:32 +08:00
6b2e37f18c gomod: update dependency for golang1.18 (#33053)
ref pingcap/tidb#32874
2022-03-17 15:10:31 +08:00
3f3a061afe ddl: Add CreatePlacementPolicyWithInfo to ddl.DDL (#32986)
close pingcap/tidb#32951
2022-03-11 11:43:51 +08:00
0c9b0c0ef2 util/testutil: cleanup testutils depend on pingcap/check (#32662)
close pingcap/tidb#32660
2022-02-28 20:01:45 +08:00
5988d0b2f4 *: update client-go and etcd version (#32457)
close pingcap/tidb#32456
2022-02-22 11:11:43 +08:00
c8bef987ae *: support variable tidb_last_ddl_info (#32414)
close pingcap/tidb#32402
2022-02-17 16:43:40 +08:00
465f655889 * : replace fmt.Sprint with strconv (#31718)
ref pingcap/tidb#31716
2022-01-17 15:11:44 +08:00
849b6ec0cb *: migrate sync.WaitGroup to util.WaitGroupWrapper (#31411)
ref pingcap/tidb#29517
2022-01-08 14:04:37 +08:00
b43c9ffa85 *: migrate sync.WaitGroup to util.WaitGroupWrapper (#31257)
ref pingcap/tidb#29517
2022-01-04 15:04:35 +08:00
3de13842b3 test: control log level with environment variables (#30871) 2021-12-24 17:03:48 +08:00
b4df7ca4dc test: make all the tests run in serial (#30692) 2021-12-14 18:06:36 +08:00
xhe
94e30df8e2 parser: fix compiling, add unit tests (#28700) 2021-10-11 23:15:25 +08:00
267a3b8162 executor: add auto id allocator execution runtime stats (#28013) 2021-10-08 17:35:24 +08:00
48c624b201 *: remove some unnecessary exported/interface functions (#28134) 2021-09-22 15:22:45 +08:00
74c507b023 test: fix t.Parallel() is called in the range method but is not reinitialised (#27939) 2021-09-17 11:30:42 +08:00
d7bb71bc1f ddl, meta: refactor auto IDs metadata interface (#27721) 2021-09-10 13:56:39 +08:00
6aec001345 ddl: support table placement option (#27799) 2021-09-07 22:54:57 +08:00
376e85b2ef *: Support SHOW PLACEMENT for placement policies (#27531) 2021-08-31 17:38:13 +08:00
777b40cb8c *: refactor Allocator.Rebase() interface (#27649) 2021-08-30 13:10:11 +08:00
8ba11a66c3 ddl: support create and drop placement policy (#27574) 2021-08-30 11:36:12 +08:00
b1f3974f10 *: refactor Allocator.Alloc() interface for separating auto IDs (#27616) 2021-08-28 15:32:05 +08:00
de22c5a9b6 meta: support storing placement policy into meta (#27251) 2021-08-23 18:08:04 +08:00
7755d25aba *: Integrate SkyWalking-eyes to check license headers in CI and fix licenses headers (#27198) 2021-08-16 18:52:00 +08:00
0f2762bc0f meta: migrate test-infra to testify (#26882) 2021-08-13 14:33:21 +08:00
9d5df9a3c5 meta/autoid: migrate test-infra to testify (#26859) 2021-08-10 12:25:15 +08:00
01a87e3257 *: solve cloud tikv disk full problem (#26302) 2021-08-08 13:21:13 +08:00