Commit Graph

532 Commits

Author SHA1 Message Date
4e4169bcc5 *: support global memory control for tidb (#37794)
ref pingcap/tidb#37816
2022-09-26 12:01:43 +08:00
b0e073478f execution: commit the transaction before responding explain analyze results to the client (#38044)
close pingcap/tidb#37373
2022-09-21 20:45:03 +08:00
ff1df75a6a *: add more tests for metadata lock and fix data race (#37930)
close pingcap/tidb#37927
2022-09-20 12:05:01 +08:00
c4638b70fd *: support metadata lock (#37393)
ref pingcap/tidb#37275
2022-09-18 20:57:00 +08:00
7eb7ca902a planner: fallback to static plan for partition table if having no global stats in dynamic prune mode (#37573)
ref pingcap/tidb#37535
2022-09-08 09:20:57 +08:00
55e86e0037 util: use channel.Clear to empty channel (#37643) 2022-09-06 19:28:55 +08:00
d435267600 statistics: track used stats status during query (#37101)
ref pingcap/tidb#36481
2022-08-25 12:14:21 +08:00
4cf7eeee64 planner: add warn log for sync stats (#36956) 2022-08-22 15:24:20 +08:00
d6d0ce7b10 *: gofmt code for adapting go 1.19 (#36832)
ref pingcap/tidb#36879
2022-08-11 12:50:49 +08:00
257c78764d test: fix race for SetDDL by moving ddl inject earlier (#36964)
close pingcap/tidb#36940
2022-08-09 10:36:47 +08:00
5ef18981cc Revert "planner: refactor the IsolationReadEngines variable for plan cache" (#36873) 2022-08-04 10:30:06 +08:00
3847d9e56f planner: refactor the IsolationReadEngines variable for plan cache (#36770)
ref pingcap/tidb#36598
2022-08-03 19:44:05 +08:00
c060208b2f *: move config file option oom-use-tmp-storage to sysvar (#36679)
ref pingcap/tidb#33769
2022-08-02 16:58:05 +08:00
c4c066554b executor: add syntax 'ADMIN SHOW DDL JOB QUERIES LIMIT m OFFSET n' to retrieve DDL commands within a certain range (#36480)
close pingcap/tidb#36198
2022-07-25 13:07:10 +08:00
48e496afc2 executor: correct the column name shown in show next_row_id (#36471)
close pingcap/tidb#36470
2022-07-25 09:41:09 +08:00
ab513bf0ca ddl: support concurrent ddl (#32169)
* 1. init ddl tables

create tidb_ddl_job, tidb_ddl_reorg, tidb_ddl_history tables with raw meta write, these 3 tables is use to replace the ddl job queue and reorg and history hash table

* 2. setup concurrent ddl env and add ddl worker pool

adds the ddl worker pool definition, the ddl job manager will find a job and ship it to a worker in the worker pool.
Also, this commit provides a sessionctx wrapper, only use in ddl relate. it just wraps begin, commit and execute

* 3. add ddl manager to handle ddl job

* 4. reorg handler for concurrent ddl

just implements the partner of the reorg information.

* 5. manage ddl jobs for concurrent ddl

add the partner of add job, delete job and many others related to history job
because many of the functions need a session now, we just change the caller

* 6. add metrics for concurrent ddl

add metrics

* 7. support multiple tables

* 8. fix test

* 9. migrate ddl between table and queue

support switch between the old and new ddl framework, migrate the existing ddl job between queue and table

* 10. check tikv version and set reorg worker count according cpu count

* *: add featuretag on tests

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* use a determined table id for 3 tables

* remove ctx value

* add GetSchemaVersionWithNonEmptyDiff function

* address tangenta and zimulala comment

* use only one etcd path

* make ActionRenameTable support multi-schema

* reset sql digest to make top sql work correct

* add comment

* fix test

* remove 0 for schema version lock

Co-authored-by: xiongjiwei <xiongjiwei1996@outlook.com>
Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
Co-authored-by: wjHuang <huangwenjun1997@gmail.com>
2022-07-20 21:20:07 +08:00
2f934d67a2 *: support show ddl jobs for sub-jobs (#36168)
ref pingcap/tidb#14766
2022-07-13 20:57:05 +08:00
637d00c05a ddl: refine history job code (#35967) 2022-07-06 11:43:02 +08:00
157c178f27 *: seperate TxnScope and ReplicaReadScope (#35877)
close pingcap/tidb#31772
2022-07-05 11:33:02 +08:00
65e0b8e541 client: KV requests with source label (#34833)
close pingcap/tidb#33963
2022-07-01 19:46:39 +08:00
5b305c34f8 txn: manage the initialization of RCCheckTS by transaction context provider (#35554)
close pingcap/tidb#35497
2022-06-29 16:14:39 +08:00
82f0faf78a executor: fix left join on partition table generate invalid lock key (#35732)
close pingcap/tidb#28073
2022-06-28 13:08:39 +08:00
31c92c67bc sessionctx: support encoding and decoding statement context (#35688)
close pingcap/tidb#35664
2022-06-27 12:20:39 +08:00
0998cba23d txn: refactor ts acquisition within build and execute phases (#35376)
close pingcap/tidb#35377
2022-06-27 11:58:38 +08:00
26df62fef2 test: improve some tests (#35092)
ref pingcap/tidb#32031
2022-06-01 18:50:28 +08:00
eb46685055 *: add methods to session.Context and refactor some code about ddl (#34699)
close pingcap/tidb#32031
2022-05-30 12:46:26 +08:00
7f023bd61b ddl: wrap some functions for ddl job (#34920)
close pingcap/tidb#34919
2022-05-29 15:38:26 +08:00
d45a9c8af8 executor, parser, sessionctx: push down InRestrictedSQL flag to proto buffer (#34861)
close pingcap/tidb#34860
2022-05-26 14:06:47 +08:00
a9614850f9 *: move config file option oom-action to sysvar (#34644)
ref pingcap/tidb#33769
2022-05-19 05:16:38 +08:00
218247e80e *: improve stack message in the panic log (#34564)
close pingcap/tidb#34356
2022-05-11 16:34:34 +08:00
33236ba8d7 *: track analyze memory usage separately with quota (#33054)
ref pingcap/tidb#29938, close pingcap/tidb#33065
2022-05-10 20:32:35 +08:00
73f3435346 ddl: move some admin function to ddl (#34527)
close pingcap/tidb#34526
2022-05-10 18:14:34 +08:00
f88dab92f9 util: use generics to implement max/min (#34197)
close pingcap/tidb#34247
2022-05-06 10:08:57 +08:00
0d5ac6f3cb sysvar, config: mapping config settings to system variables. (#33279)
ref pingcap/tidb#32887
2022-04-29 13:20:52 +08:00
1bf64c60f4 *: Refactor FieldType structure (#33569)
close pingcap/tidb#32116
2022-04-26 19:28:51 +08:00
fb342ff861 topsql: fix issue of topsql failed catch the running SQL when topsql is enabled in execution (#33861)
close pingcap/tidb#33859
2022-04-26 13:16:51 +08:00
d23a81488a *: Move stale read context to TxnManager (#33812)
close pingcap/tidb#31954, close pingcap/tidb#33014, close pingcap/tidb#33832
2022-04-25 16:52:51 +08:00
1d485d11ed topsql: fix admin check/cleanup/recover statement doesn't set tag for RPC request (#33869)
close pingcap/tidb#33716
2022-04-13 18:00:36 +08:00
d4d43ba0b4 txn: support read consistency read with ts checking (#32922)
close pingcap/tidb#33159
2022-03-16 20:49:52 +08:00
4ab66b8ac2 executor: refine execution of cancelDDL (#32914)
close pingcap/tidb#32913
2022-03-09 14:51:49 +08:00
493eb45c75 *: table partition dynamic prune mode with Physical Table ID from unistore (#31634)
close pingcap/tidb#29851
2022-03-04 01:21:46 +08:00
7e627e8222 executor: make the create/start/end time in admin show ddl jobs TZ aware (#32450)
ref pingcap/tidb#26642
2022-02-23 17:25:43 +08:00
f60a589147 executor: tiny refactor code to improve CheckTableExec (#32295)
close pingcap/tidb#32294
2022-02-22 16:27:43 +08:00
e592cef7e0 *: add create time to admin show ddl jobs (#32435)
ref pingcap/tidb#23494
2022-02-17 21:17:40 +08:00
a31ca21830 planner: support sysdate behavior according to sysdate_is_now (#31881)
close pingcap/tidb#31872
2022-02-16 18:53:39 +08:00
1cf4fcfa73 *: support prepared plan cache for cached table (#32139)
close pingcap/tidb#32003
2022-02-14 12:29:37 +08:00
9c64224c49 *: Reduce data inconsistencies (#31547)
ref pingcap/tidb#26833
2022-02-11 13:51:36 +08:00
e7da7d4f95 *: change fsp from int8 to int (#28347) 2022-01-27 13:59:12 +08:00
2d62d23b20 planner: support trace candidates for Datasource (#31810)
ref pingcap/tidb#29661
2022-01-21 11:11:45 +08:00
a0e31aa987 *: fix data race in the CheckMb4ValueInUTF8 (#31781)
close pingcap/tidb#31780
2022-01-19 17:33:45 +08:00