Commit Graph

165 Commits

Author SHA1 Message Date
46cb6dc679 executor: fix column_default with timestamp and bit type (#36851)
close pingcap/tidb#36027
2022-08-04 15:30:06 +08:00
bf23ee9090 executor: invalidate infoschema's stats cache after analyze (#32803)
close pingcap/tidb#32693
2022-08-03 22:00:05 +08:00
0b1d3e0da3 *: cleanup sysvar API usage (#36640)
close pingcap/tidb#36639
2022-08-02 07:54:04 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
e7ee7e2280 executor: refine the error message for TABLE_STORAGE_STATS (#36464)
close pingcap/tidb#36403
2022-08-01 11:42:05 +08:00
6baea73277 *: should replace errors.New(fmt.Sprintf(...)) with fmt.Errorf(...) (#36660) 2022-07-28 19:23:11 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
8c380e3107 ddl: support alter table options for multi-schema change (#36236)
ref pingcap/tidb#14766, close pingcap/tidb#36234
2022-07-18 10:39:07 +08:00
2f934d67a2 *: support show ddl jobs for sub-jobs (#36168)
ref pingcap/tidb#14766
2022-07-13 20:57:05 +08:00
e5487a94e0 perfschema: add session_variables table to performance_schema (#36003)
close pingcap/tidb#35894
2022-07-08 10:33:03 +08:00
6e22e47f06 parser,ddl: support 'set tiflash mode' ddl and support check tiflash mode in tiflash_replica table (#35851)
ref pingcap/tidb#35850
2022-07-07 15:15:03 +08:00
adab58b360 infoschema, executor: Add variables_info table to see sysvar details (#35995)
close pingcap/tidb#21446
2022-07-07 11:51:02 +08:00
55aea2787d *: use pdqsort to improve sort performance (#34404)
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
df9b54bcb3 txn, session: Add (cluster_)trx_summary table (#28835)
ref pingcap/tidb#34457
2022-06-23 11:16:36 +08:00
d4dc6b54c6 *: enable staticcheck and prealloc on nogo (#35486)
ref pingcap/tidb#35345
2022-06-22 22:00:37 +08:00
f1694589f4 txn: Add lock resolving to data_lock_waits (#33993)
close pingcap/tidb#34609
2022-06-01 00:30:26 +08:00
d4df6b3c90 executor: get schema and outname of view once in the dataForColumnsInTable (#34658)
close pingcap/tidb#34657
2022-05-17 14:14:38 +08:00
e1ccd33247 executor: fix DATA RACE for reading information_schema.columns where there are views (#34538)
close pingcap/tidb#34509
2022-05-16 13:52:36 +08:00
f88dab92f9 util: use generics to implement max/min (#34197)
close pingcap/tidb#34247
2022-05-06 10:08:57 +08:00
1bf64c60f4 *: Refactor FieldType structure (#33569)
close pingcap/tidb#32116
2022-04-26 19:28:51 +08:00
e6d55e14fa executor/infoschema_reader.go: skip the unidentifiable table-attributes (#34129)
close pingcap/tidb#33665
2022-04-22 14:08:04 +08:00
0f4706418e *: track cluster-level analyze jobs and make it persistent (#32215)
close pingcap/tidb#32403
2022-03-31 21:06:29 +08:00
b35b30bbd5 executor: support extractor for mem table region status (#33498)
close pingcap/tidb#33348
2022-03-30 16:12:29 +08:00
c5a0737e56 executor, infoschema: Add foreign key constraint to infoschema.table_constraints (#33360)
close pingcap/tidb#28918
2022-03-25 17:24:34 +08:00
284b90d2d5 planner: misuse like2regexp and regexp when to query information.schema (#32490)
close pingcap/tidb#32451
2022-03-10 10:57:50 +08:00
4f072fb8c0 infoschema,executor: fix data value and column type mismatch on infoschema tables tikv_region_status, cluster_config (#32756)
close pingcap/tidb#32755
2022-03-03 12:23:46 +08:00
1268bf0e1f executor: fix format of bit default value on INFORMATION_SCHEMA.COLUMNS (#32701)
close pingcap/tidb#32655
2022-03-02 23:11:47 +08:00
40f6b112f3 executor: Should not show the table attribute that the table has been dropped by user in information_schema.attributes (#32559)
close pingcap/tidb#29686
2022-03-01 13:13:45 +08:00
584ae75df5 *: use session time_zone for is.tables and show table status (#32449)
ref pingcap/tidb#26642
2022-03-01 06:09:45 +08:00
e592cef7e0 *: add create time to admin show ddl jobs (#32435)
ref pingcap/tidb#23494
2022-02-17 21:17:40 +08:00
3c77cf9ada statement table: fixed issue #32156 time_zone not sync in stmt table (#32315)
close pingcap/tidb#32156
2022-02-14 18:45:38 +08:00
db
43b818b80d executor: add retriver for tikv_region_peers (#30657)
close pingcap/tidb#31050
2022-02-07 16:47:35 +08:00
172701ce58 *: followers in information_schema.placement_policies should show default count when followers not set (#31927)
close pingcap/tidb#31702
2022-01-25 11:12:11 +08:00
2e1cff73f3 *: add ExecRestrictedSQL() func for RestrictedSQLExecutor interface (#31618)
ref pingcap/tidb#30918
2022-01-24 21:30:11 +08:00
43294a2938 *: Remove column TIBD_DIRECT_PLACEMENT from some sys tables (#31741)
close pingcap/tidb#31426
2022-01-18 09:47:44 +08:00
4bab2b6dff *: Rename table placement_policies to placement_rules (#31698)
close pingcap/tidb#31425
2022-01-17 16:01:45 +08:00
4b63b8cc84 executor: fix the printing of index comment in information_schema (#31266)
close pingcap/tidb#29740
2022-01-13 22:31:42 +08:00
d101fc0c32 *: case-insensitivity with LIKE when query information_schema.columns (#31511)
close pingcap/tidb#31554
2022-01-12 14:21:43 +08:00
6b1010f405 *: enable golangci-lint prealloc (#31521)
close pingcap/tidb#29004
2022-01-11 01:09:41 +08:00
a082abdc6f *: fix case-sensitivity issue with EQ/IN when query information_schema.columns (#31463)
ref pingcap/tidb#31481
2022-01-10 13:31:41 +08:00
5cd37f0008 session: fix data race in ParseWithParamsInternal (#31058)
close pingcap/tidb#30918
2022-01-06 21:02:37 +08:00
5e031442d9 executor: enhance the strategy of the sampling rate calculation (#31016)
ref tikv/tikv#11669
2021-12-28 20:47:49 +08:00
f35e84c2e1 *: get tiflash http(s) port from tiflash status port instead of etcd (#30901) 2021-12-28 16:47:49 +08:00
0af4b77b6b schema: sequence should always be the one row (#30784)
close pingcap/tidb#30786
2021-12-28 13:19:49 +08:00
d2ed2ae2b2 executor: display 'show create table' and INFOSCHEMA for cached table correctly (#30951)
close pingcap/tidb#30950
2021-12-23 14:45:47 +08:00
23c71f1a3b execute: don't transform charset in internal sql (#30843)
close pingcap/tidb#30789
2021-12-20 17:15:46 +08:00
c08f7fc65c *: show PK name when decoding the clustered index row key (#30623) 2021-12-10 21:53:58 +08:00
7aa86cc96a *: Enable gosec for implicit memory aliasing in for loop (#28996) 2021-11-19 20:07:48 +08:00
b076e193b3 executor: Add support information_schema.schemata for placement rule (#29780) 2021-11-16 04:31:06 +08:00