Commit Graph

307 Commits

Author SHA1 Message Date
9488ca9db6 *: Add backfill job related tables and operations (#39616)
close pingcap/tidb#37122
2022-12-12 14:34:51 +08:00
44cd0b041a ddl, session: let ddl related tables controlled by split-table (#38416)
close pingcap/tidb#38346
2022-10-25 14:43:56 +08:00
e8daf1ad7d session: fix data race in the TestInitMetaTable (#37464)
close pingcap/tidb#37463
2022-08-30 16:42:23 +08:00
xhe
9a16a8dd19 *: replace defer clean with t.Cleanup (#36722)
close pingcap/tidb#36721
2022-08-01 17:34:05 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
901f042d5d realtikvtest: dedicated package for real tikv tests (#34578)
ref pingcap/tidb#28328
2022-05-12 11:18:34 +08:00
145058cd75 session: migrate test-infra to testify for parts of session_test (#34560)
Signed-off-by: tison <wander4096@gmail.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-05-11 16:16:13 +08:00
a0f55d36ee session: migrate test-infra to testify for tidbAsLibrarySuite (#34178)
ref pingcap/tidb#28328
2022-04-27 17:46:52 +08:00
1bf64c60f4 *: Refactor FieldType structure (#33569)
close pingcap/tidb#32116
2022-04-26 19:28:51 +08:00
4d3a3c259a server: use max_allowed_packet to limit the packet size. (#33651)
close pingcap/tidb#31422
2022-04-18 11:24:03 +08:00
b5de819d00 util: fix memory.reArrangeFallback cpu usage (#30414)
close pingcap/tidb#30353
2022-04-15 12:48:35 +08:00
c56c036d2a *: refactor placement bundle in infoschema (#33967)
close pingcap/tidb#33968
2022-04-15 11:04:35 +08:00
b37b3b1afc session, sessionctx: Make sysvar tidb_read_staleness TypeInt (#32794)
close pingcap/tidb#32763
2022-04-06 14:54:31 +08:00
09edaee061 store: avoid setting ratelimit action in tracker when disabled (#31110)
ref pingcap/tidb#30353
2022-03-29 11:02:30 +08:00
843b0f43db executor: migrate test-infra to testify for executor_test.go testSuiteWithData (#33402)
ref pingcap/tidb#28577
2022-03-25 14:06:33 +08:00
f6a44bf72c *: add limitation for UserName and HostName. (#33224)
close pingcap/tidb#32682
2022-03-21 16:06:33 +08:00
3058104232 ddl: disable some DDL operation when a table is cached (#32827)
close pingcap/tidb#32826
2022-03-17 18:04:31 +08:00
d981c0e06a sysvar: add INSTANCE scope for system variable (#32888)
ref pingcap/tidb#32887
2022-03-16 11:15:52 +08:00
fcf7bd8c88 sysvar: rename sysdate_is_now as tidb_sysdate_is_now (#32957)
close pingcap/tidb#31872
2022-03-11 11:19:50 +08:00
22f4c33d40 *: better handle sysvar upgrades from older versions (#31583)
close pingcap/tidb#31538
2022-03-10 23:59:51 +08:00
27eed7af0a session: migrate test-infra to testify for isolation_test.go (#32481)
close pingcap/tidb#28324, close pingcap/tidb#32069
2022-03-10 15:05:50 +08:00
493eb45c75 *: table partition dynamic prune mode with Physical Table ID from unistore (#31634)
close pingcap/tidb#29851
2022-03-04 01:21:46 +08:00
584ae75df5 *: use session time_zone for is.tables and show table status (#32449)
ref pingcap/tidb#26642
2022-03-01 06:09:45 +08:00
5988d0b2f4 *: update client-go and etcd version (#32457)
close pingcap/tidb#32456
2022-02-22 11:11:43 +08:00
a31ca21830 planner: support sysdate behavior according to sysdate_is_now (#31881)
close pingcap/tidb#31872
2022-02-16 18:53:39 +08:00
4dfa95b7a6 session: migrate test-infra to testify for session/session_fail_test.go (#32260)
close pingcap/tidb#28327
2022-02-16 10:57:39 +08:00
1cf4fcfa73 *: support prepared plan cache for cached table (#32139)
close pingcap/tidb#32003
2022-02-14 12:29:37 +08:00
3738dec53e *: enable the new collation by default (#32016)
ref pingcap/tidb#32015
2022-02-08 12:53:35 +08:00
2e1cff73f3 *: add ExecRestrictedSQL() func for RestrictedSQLExecutor interface (#31618)
ref pingcap/tidb#30918
2022-01-24 21:30:11 +08:00
c589ee5471 *: remove direct placement from models (#31816)
close pingcap/tidb#31427
2022-01-20 00:47:45 +08:00
4fcbb2c914 *: fix data race on the SchemaOutOfDateRetryTimes/SchemaOutOfDateRetryInterval (#31815)
close pingcap/tidb#31812
2022-01-19 18:51:45 +08:00
8ee88265cd planner, distsql: fix the Stale Read and Local Txn compatibility (#31606)
close pingcap/tidb#31604
2022-01-13 22:09:42 +08:00
849b6ec0cb *: migrate sync.WaitGroup to util.WaitGroupWrapper (#31411)
ref pingcap/tidb#29517
2022-01-08 14:04:37 +08:00
5cd37f0008 session: fix data race in ParseWithParamsInternal (#31058)
close pingcap/tidb#30918
2022-01-06 21:02:37 +08:00
f39a328152 session: forbid setting both tidb_snapshot and tidb_read_staleness (#31082) 2021-12-29 15:47:50 +08:00
7121bf0289 planner: fix index merge plan when expr cannot be pushed to tikv (#30341)
close pingcap/tidb#30200
2021-12-23 13:39:47 +08:00
529ce88c1c *: add TxnManager to manage txn in session (#30574)
* *: add TxnManager to manage txn in session

* modify

* add tests

* move failpoint content to a single file
2021-12-22 13:53:43 +08:00
23c71f1a3b execute: don't transform charset in internal sql (#30843)
close pingcap/tidb#30789
2021-12-20 17:15:46 +08:00
6eb11b300f *: implement renew write lock lease for cached table (#30206) 2021-12-16 12:12:35 +08:00
1f26870ccb *: migrate sync.WaitGroup to util.WaitGroupWrapper (#30644) 2021-12-13 12:04:34 +08:00
e520e46614 planner/core, session: fix error message of wrong variable scope (#30510) 2021-12-08 14:53:57 +08:00
cbe5240dd0 session, sessionctx/variable: fix validation recursion bug (#30293) 2021-12-02 18:47:54 +08:00
7fc6ebbda4 privilege, session, server: consistently map user login to identity (#30204) 2021-11-30 17:01:53 +08:00
fac9c427e6 session, sessionctx/variable: add relaxed validation for global vars (#29594) 2021-11-18 18:31:48 +08:00
3d9196ddea *: allow setting @@tidb_tso_client_batch_max_wait_time to a float millisecond (#29699) 2021-11-14 03:29:05 +08:00
55a38a1c76 *: tiny clean up the RecordSet NewChunk() method (#29232) 2021-11-02 20:02:51 +08:00
b84eb376cf *: Add test: TestSameNameObjectWithLocalTemporaryTable (#29278) 2021-11-01 17:32:51 +08:00
1f39a9f81d *: add two session variables to control the PD client option (#29120) 2021-10-31 00:12:49 +08:00
ce8e734ea2 variable: rename tmp_table_size to tidb_tmp_table_max_size (#29123) 2021-10-28 17:24:50 +08:00
676683383b *: add support for removed sysvars (#28931) 2021-10-22 11:32:46 +08:00