Commit Graph

898 Commits

Author SHA1 Message Date
5a39851554 executor: fix missing index names in stmt summary/slow log for [Batch]PointGet (#37073)
close pingcap/tidb#37066
2022-08-12 18:42:49 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
7d744b18e2 planner: remove execID in ExecuteStmt (#36967)
ref pingcap/tidb#36598
2022-08-09 14:10:47 +08:00
d76074623c planner: unify the parameters name in plan cache (#36899)
ref pingcap/tidb#36598
2022-08-05 17:20:06 +08:00
158ba1a1d9 *: enable part revive for all code (#36703) 2022-08-01 14:02:06 +08:00
c4c066554b executor: add syntax 'ADMIN SHOW DDL JOB QUERIES LIMIT m OFFSET n' to retrieve DDL commands within a certain range (#36480)
close pingcap/tidb#36198
2022-07-25 13:07:10 +08:00
8bc002e77c table partition: add telemetry for partition table (#36204)
close pingcap/tidb#34949
2022-07-22 11:53:09 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
a6b3f3d454 compact: Add syntax for COMPACT command without specifying the replica (#36368)
ref pingcap/tidb#34749
2022-07-20 16:53:09 +08:00
afd71bdefd executor: support dispatch cop request to closest replica adaptively (#35927)
ref pingcap/tidb#35926
2022-07-19 17:59:07 +08:00
5a01b63475 executor: fix dead loop for indexMergeJoin in paging. (#35918)
close pingcap/tidb#35831
2022-07-11 11:11:05 +08:00
adab58b360 infoschema, executor: Add variables_info table to see sysvar details (#35995)
close pingcap/tidb#21446
2022-07-07 11:51:02 +08:00
c76d686e67 *: add telemetry support for multi-schema change (#35977)
ref pingcap/tidb#14766
2022-07-06 16:27:03 +08:00
55aea2787d *: use pdqsort to improve sort performance (#34404)
close pingcap/tidb#34250
2022-07-06 13:41:02 +08:00
0f7faa67d8 ddl: refine GetDDLInfo function (#35969) 2022-07-06 13:19:02 +08:00
441c9cde30 txn: rename snapshot related methods in txnManager. (#35912)
close pingcap/tidb#35915
2022-07-05 12:37:01 +08:00
157c178f27 *: seperate TxnScope and ReplicaReadScope (#35877)
close pingcap/tidb#31772
2022-07-05 11:33:02 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
16e5815f18 txn: txnManager providers GetReadSnapshot and GetForUpdateSnapshot. (#35788)
close pingcap/tidb#35810
2022-07-01 18:12:40 +08:00
488712661c *: Remove some useless staleness code (#35849)
close pingcap/tidb#35848
2022-06-30 17:10:38 +08:00
f0d5f6e9cd txn: remove legacy.SimpleTxnContextProvider (#35667)
close pingcap/tidb#35666
2022-06-29 13:52:39 +08:00
d99b358225 *: only add default value for final aggregation to fix the aggregate push down (partition) union case (#35443)
close pingcap/tidb#35295
2022-06-28 12:08:39 +08:00
0998cba23d txn: refactor ts acquisition within build and execute phases (#35376)
close pingcap/tidb#35377
2022-06-27 11:58:38 +08:00
df9b54bcb3 txn, session: Add (cluster_)trx_summary table (#28835)
ref pingcap/tidb#34457
2022-06-23 11:16:36 +08:00
d4dc6b54c6 *: enable staticcheck and prealloc on nogo (#35486)
ref pingcap/tidb#35345
2022-06-22 22:00:37 +08:00
fc833a30b3 planner, executor: add some comments about how we decide sample rate (#34140)
ref pingcap/tidb#24182
2022-06-22 18:34:37 +08:00
2910dee858 executor: fix wrong runtime stats for ShuffleReceiver (#35293)
close pingcap/tidb#34987
2022-06-22 13:52:37 +08:00
45a9a7e5ab txn: fix bug that some times lock ts and read ts are not the same (#35470)
close pingcap/tidb#35459
2022-06-17 18:20:36 +08:00
ad1cb783c4 *: support paging protocol on unistore (#35244)
ref pingcap/tidb#35242, close pingcap/tidb#35243
2022-06-14 21:46:33 +08:00
b0245cda58 *: clean up coprocessor streaming code (#35277)
close pingcap/tidb#35276
2022-06-10 10:50:31 +08:00
22e9f4dc9e txn: Provide PessimisticRCTxnContextProvider for RC isolation (#34702)
close pingcap/tidb#34746
2022-06-02 15:36:28 +08:00
c8468a7010 distsql,executor: using paging protocol for all coprocessor requests (#35068)
close pingcap/tidb#35067
2022-06-01 11:06:27 +08:00
d45a9c8af8 executor, parser, sessionctx: push down InRestrictedSQL flag to proto buffer (#34861)
close pingcap/tidb#34860
2022-05-26 14:06:47 +08:00
79938e695c dml: support for show count(*) warnings | errors (#34721)
close pingcap/tidb#25068
2022-05-23 15:50:46 +08:00
81a852077a executor, parser: indicate analyze is auto or not in proto buffer (#34608)
close pingcap/tidb#34607
2022-05-20 17:42:38 +08:00
01fb9355d6 executor: add ALTER TABLE COMPACT support (#34741)
ref pingcap/tidb#34749
2022-05-19 00:44:38 +08:00
0ac659b4fb planner: fix the issue that the optimizer caches wrong TableDual plans under binary protocol (#34709)
close pingcap/tidb#34678, close pingcap/tidb#34690
2022-05-17 16:24:39 +08:00
d4df6b3c90 executor: get schema and outname of view once in the dataForColumnsInTable (#34658)
close pingcap/tidb#34657
2022-05-17 14:14:38 +08:00
5ca242761c executor: add test cover Analyze task for evicted index (#34622)
ref pingcap/tidb#34052
2022-05-13 14:46:35 +08:00
bbd7541322 *: refine 'tidb_snapshot' behavior (#34573)
close pingcap/tidb#34529
2022-05-11 20:54:34 +08:00
50f3d8faf8 *: retry auto-analyze with adjusted samplerate when oom panic (#34387)
close pingcap/tidb#29938
2022-05-11 18:08:34 +08:00
53f228af45 sysvari: enable statsCache lru by config (#34278)
* add statsquota variable

Signed-off-by: yisaer <disxiaofei@163.com>

* add test

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

* fix conflict

Signed-off-by: yisaer <disxiaofei@163.com>

* address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

address the comment

Signed-off-by: yisaer <disxiaofei@163.com>

fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

* fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

* fix duplicated plan

Signed-off-by: yisaer <disxiaofei@163.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
2022-05-10 23:49:54 +08:00
33236ba8d7 *: track analyze memory usage separately with quota (#33054)
ref pingcap/tidb#29938, close pingcap/tidb#33065
2022-05-10 20:32:35 +08:00
73f3435346 ddl: move some admin function to ddl (#34527)
close pingcap/tidb#34526
2022-05-10 18:14:34 +08:00
2258bc54c4 txn: Add EnterNewTxn and OnStmtStart methods to TxnManager (#34263)
close pingcap/tidb#34390
2022-05-07 21:02:32 +08:00
f88dab92f9 util: use generics to implement max/min (#34197)
close pingcap/tidb#34247
2022-05-06 10:08:57 +08:00
1bf64c60f4 *: Refactor FieldType structure (#33569)
close pingcap/tidb#32116
2022-04-26 19:28:51 +08:00
d23a81488a *: Move stale read context to TxnManager (#33812)
close pingcap/tidb#31954, close pingcap/tidb#33014, close pingcap/tidb#33832
2022-04-25 16:52:51 +08:00
e21b435d0c *: fix index join on partition table data race (#33979)
ref pingcap/tidb#32846, close pingcap/tidb#33751, ref pingcap/tidb#33762
2022-04-19 09:48:02 +08:00
f988f54550 executor: add memory tracker for quering slow_query to avoid TiDB server oom (#33953)
close pingcap/tidb#33893
2022-04-14 14:54:36 +08:00